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Chapter  1 


INTRODUCTION 

1 . 1  Introduction 

The  bilevel  programming  problem  (BLPP)  is  a  model 
for  a  leader-follower  game  in  which  two  players  are 
trying  to  maximize  their  individual  objective  functions, 
F(x, /)  and  f(x,y),  respectively  (see  Basar  and  Selbuz 
1979,  or  Simaan  and  Cruz  1973).  Play  is  defined  as 
sequential  and  the  mood  as  uncooperative.  The  decision 
variables  are  partitioned  amongst  the  players  in  such  a 
way  that  neither  can  dominate  the  other.  The  leader 

nl 

goes  first  and  through  his  choice  of  x  €  X  E  R  ,  is 

able  to  influence  but  not  control  the  actions  of  the 

follower.  This  is  achieved  by  reducing  the  set  of 

feasible  choices  available  to  the  follower. 

Subsequently,  the  follower  reacts  to  the  leader's 

n* 

decision  by  choosing  a  y  €  Y  E  R 


in  an  effort  to 


2 


maximize  his  payoff.  In  so  doing,  he  indirectly  affects 
the  leader's  outcome. 


The  linear  BLPP  can  be  written  in  the 

following 

form. 

1  2 

Max  F(x,y)  =  c  x  +  c  y  where  y  solves 

(1.1a) 

X 

Max  f(x,y)  =  d1x  +  d2y 

(1.1b) 

Y 

subject  to  Ax  +  By  <  b 

(1.1c) 

x  €  X,  y  e  Y 

(l.ld) 

Ill  2 

where  c  and  d  are  n  -dimensional  row  vectors,  c  and 

2  2  1 
d  are  n  -dimensional  row  vectors,  A  is  an  m  x  n  - 

2 

dimensional  matrix,  B  is  an  m  x  n  -dimensional  matrix,  b 

n1  na 

is  an  m-dimensional  column  vector,  X  E  R  ,  Y  E  R  ,  and 
the  nonnegativity  requirements  on  the  decision  variables 
are  subsumed  in  (1.1c).  The  purpose  of  this 
dissertation  is  to  develop  and  test  a  set  of  algorithms 
to  solve  problem  (1.1)  and  its  mixed  integer  extensions. 
1 . 2  Overview 

The  linear  bilevel  programming  problem  (BLPP) 
provides  the  focus  of  this  dissertation.  A  review  of 


the  work  done  on  the  BLPP  is  presented  in  Chapter  2 .  In 
Chapter  3,  notation,  definitions,  and  some  theorems  are 
given.  The  focus  of  Chapter  4  is  the  BLPP  where  all  the 
variables  are  binary.  An  algorithm  for  solving  this 
problem  is  created,  and  computational  results  are 
presented.  In  Chapter  5,  an  algorithm  which  utilizes 
branch  and  bound  techniques  to  solve  the  continuous 
linear  BLPP  is  developed.  Computational  experience  is 
also  reported.  Chapter  6  centers  on  the  mixed  integer 
BLPP.  The  pitfalls  encountered  in  working  with  this 
problem  are  discussed.  Because  of  these  pitfalls, 
algorithms  which  are  heuristics  are  presented.  These 
algorithms  find  good  feasible  solutions  for  the  mixed 
integer  case.  The  computational  results  achieved  using 
these  heuristics  are  shown.  A  production  planning 
problem  is  examined  in  Chapter  7.  Versions  of  this 
problem  are  presented  which  use  the  algorithm  for  the 
continuous  linear  BLPP  and  the  algorithms  for  the  mixed 
integer  BLPP.  Conclusions  are  presented  in  Chapter  8. 

In  Appendix  A,  listings  of  the  computer  programs 
associated  with  the  algorithms  of  Chapters  4,  5,  and  6 
are  given.  The  more  general  multilevel  programming 
problem  is  discussed  in  Appendix  B. 


CHAPTER  2 


LITERATURE  SEARCH  1 

2 . 1  Introduction 

Multiple  criteria  decision  making  has  often  been 
used  to  study  the  conflict  that  naturally  arises  in 
hierarchical  systems  (see  Bard  1983c,  Haimes  et  al . 

1975,  Mahoud  1977,  Messarovic  et  al .  1970).  A  number  of  - 

techniques  that  have  proven  successful  in  modeling  the 

individual  preferences  and  interactions  which  prevail  in  j 

« 

such  systems  include  vector  maximization  (see  Tarvainen  ! 

I 

and  Haimes  1977,  Yu  and  Zeleny  1981),  multiattribute  j 

< 

utility  theory  (see  Keeney  and  Raiffa  1976,  Zeleny  | 

f 

1982),  and  goal  programming  (see  Charnes  et  al .  1967,  j 

Winkofsky  et  al .  1981).  Their  major  drawback,  however,  , 

stems  from  the  need  to  postulate  a  single  decision  l 

making  unit  with  an  accompanying  set  of  goals  for  each  ! 

group  member.  This  formulation  sidesteps  the  reactive 
nature  of  most  multilevel  organizations.  In  contrast, 


game  theoretic  approaches  explicitly  consider  the 
individual  decision  making  units  or  players  by  assigning 
each  a  unique  objective  function  and  control  set.  When 
strategies  are  selected  simultaneously,  in  a 
noncooperative  manner,  solutions  are  defined  as 
equilibrium  points  (see  Basar  and  Olsder  1979,  Zangwill 
and  Garcia  1981)  so  that  at  optimality  no  player  can  do 
better  by  unilaterally  altering  his  choice.  There  are 
other  types  of  noncooperative  decision  problems,  though, 
where  one  (or  more)  of  the  players  has  the  ability  or 
authority  to  impose  his  preferences  on  a  subset  of  the 
others.  In  such  a  situation,  it  is  necessary  to 
introduce  a  hierarchical  solution  concept  known  as  a 
Stackelberg  strategy  (see  Basar  and  Olsder  1982,  Basar 
and  Selbuz  1979,  Vincent  and  Grantham  1981).  The 
multilevel  programming  problem  (MLPP)  (see  Bard  1982, 
Bard  and  Falk  1982a  and  1982b,  Basar  and  Olsder  1982, 
Bialas  and  Karwan  1982)  conceptually  extends  the  open- 
loop  Stackelberg  model  to  p  players.  Motions  common  to 
the  latter;  namely,  the  feasible  region  and  the  rational 
reaction  set,  are  precisely  defined  for  the  general 
problem  in  Appendix  B  (also  see  Chang  and  Luh 


6 


1982a  for  a  comparison  with  the  inducible  region) ;  a 
working  definition  is  given  in  Section  2.3. 

2 . 2  Relevance  of  the  Model 

Multilevel  programming  can  be  relevant  to  almost 
any  hierarchical  system  or  organization  in  which 
independent  agents  make  decisions  in  a  sequential  but 
interrelated  fashion.  Problems  found  in  such  areas  as 
government  regulation  (see  Bard  1983-1984,  Cassidy  et 
al .  1971),  equipment  scheduling  (see  Aoki  and  Satoh 
1962),  strategic  warfare  (see  Bracken  et_  al_.  1977),  and 
decentralized  control  (see  Bard  1983,  Burton  and  Obel 
1977)  readily  lend  themselves  to  this  format.  As  an 
example,  consider  a  firm  concerned  with  product  design 
and  development.  At  the  highest  level  there  are  overall 
corporate  goals,  such  as  market  share,  profit,  and 
industrial  leadership.  At  the  next  level  there  are 
research  and  design  goals,  and  budgeting  and 
technological  constraints.  At  the  bottom  level, 
tradeoffs  must  be  made  between  subsystem  performance  and 
design  characteristics.  The  process  is  one  of  decision, 
reaction,  and  feedback,  a  familiar  systems  engineering 
problem. 


In  this  example,  if  a  lack  of  communications  exists 


among  the  levels,  or  if  lower  divisions  are  competing 
against  one  another  for  company  resources  and  producing 
diseconomies  as  a  result;  (e.g.  see  Bard  1983c,  Baumol 
and  Fabian  1964,  Burton  and  Obel  1977),  then  multilevel 
programming  should  provide  a  suitable  analytic  framework 
(note  that  MLPP  solutions  are  not  necessarily  Pareto- 
optimal,  see  Bard  and  Falk  1982b,  Zeleny  1982).  If, 
however,  cooperation  and  central  planning  are  the  rule, 
another  approach  may  be  required. 

2 . 3  Problem  Formulation 

Multilevel  programming  was  first  defined  by  Candler 
and  Townsley  (1982)  as  a  generalization  of  mathematical 
programming.  In  this  context,  the  constraint  region  is 
implicitly  determined  by  a  series  of  optimization 
problems  which  must  be  solved  in  a  predetermined 
sequence . 

Alternatively,  the  problem  can  be  viewed  as  an  n- 
person,  nonzero-sum  game  with  perfect  information  where 
the  order  of  play  is  specified  at  the  outset  and  the 
players'  control  sets  are  no  longer  assumed  to  be 
disjoint.  As  a  consequence,  the  moves  available  to  a 
player  change  as  the  game  progresses  and  hence ,  may  be 


limited  by  the  actions  of  the  preceding  players.  When 
interdependent  control  sets  are  introduced,  the 
difficulty  of  the  overall  problem  markedly  increases. 

The  problem  that  will  be  addressed  differs  from  the 
conventional  formulations  of  the  n-person  game  in  that 
the  players  are  now  required  to  move  in  turn.  When  the 
moves  are  assumed  to  occur  simultaneously,  disagreement 
often  arises  as  to  which  of  several  measures  is  most 
likely  to  predict  the  actual  outcome  (e.g.,  see  Luce  and 
Raiffa  1957).  To  avoid  such  arguments,  an  appeal  is 
made  to  the  natural  relationship  that  exists  between  the 
multilevel  program  and  the  standard  mathematical 
program,  and  a  solution  is  defined  accordingly  (Bard  and 
Falk  1982a) . 

To  formulate  the  problem,  consider  a  system 

comprised  of  p  levels,  each  characterized  by  individual 

objective  functions  f*,  i=l,...,p,  defined  over  a 

jointly  dependent  constraint  set  S,  which  are  to  be 

maximized  by  the  respective  players.  Assume  that 

decisions  are  made  sequentially  beginning  with  player  1 

who  has  control  over  a  vector  x1  in  X1,  followed  by 

2  2 

player  2  who  has  control  over  a  vector  x  in  X  ,  down 
through  player  p  who  has  control  over  a  vector  xp  in  Xp, 


i  n'  i 

where  X  (i=l,...,p)  are  nonempty  subsets  of  R  ;  X  n 

X^  =  <t>,  i*j  =  1 ,  .  .  .  ,  p ;  n  =  n1+...+n^>;  and  x  = 

(x1,...^^)  6  Rn.  Further  assume  that  S  is  a  compact 

subset  of  R  ,  x  e  S,  and  each  fA  maps  S  into  k.  By 

implication,  the  choice  made  by  a  higher  level  player 

may  affect  the  choices  available  to  a  lower  level  player 

through  S;  the  strategy  selected  by  any  member  of  the 

system,  however,  may  influence  the  outcome  realized  by 

any  other  member  through  the  latter's  objective 

function.  As  Bialas  and  Karwan  (1982)  point  out,  this 

is  in  fact  the  nature  of  hierarchical  systems  where 

interacting  decision  making  units  execute  their 

strategies  in  a  preassigned  order  in  an  attempt  to 

maximize  net  benefits.  In  addition,  each  player's 

control  Instruments  may  allow  him  to  influence  but  not 

dictate  the  policies  of  another  and  thereby  improve  his 

own  performance  through  the  resultant  externalities. 

The  following  nested  optimization  problem  known  as 
the  multilevel  programming  problem  (MLPP)  captures  this 


structure : 


Max  f  (x) 


where  x  solves 


X1€X1 


Max 

X2€X 


2 


(X) 


where  x 


3 


solves 


(2.1) 


Max  fp  J(xl 

xp_1ex£,_l 


where  x^  solves 


Max  fP(x) 


xpexp 

subject  to  xsfx1 , . . . ,xp) €S . 


When  p  =  1,  problem  (2.1)  reduces  to  a  standard 

1  2 

nonlinear  program;  when  p  =  2  and  f  =  -f  the  general 
"max-min"  problem  (see  Falk  1973)  results.  (A  more 
formal  definition  of  MLPP  and  related  concepts  is  given 
in  Appendix  B . ) 

From  an  individual  perspective,  player  p  faces  a 
problem  parameterized  in  x1  through  xp  1 


Once  these 


variables  are  selected,  he  has  only  to  solve  a  simple 
optimization  problem.  Player  1,  however,  is  required  to 
make  the  first  move  and  therefore  faces  a  problem 
implicit  in  x  through  xp .  In  effect,  he  must 
anticipate  how  each  of  the  succeeding  players  will  react 

to  the  control  x1 .  Finally,  player  k  faces  a  problem 

1  k-1  k+l 

parameterized  in  x  through  x  and  implicit  in  x 

through  x^.  As  shown  in  Appendix  B,  it  is  possible  to 

inductively  derive  a  feasible  region  for  each  player 

beginning  at  the  lowest  level  which  is  level  1.  An 

example  for  the  linear  three  level  programming  problem 

is  also  given  to  highlight  these  concepts. 

The  principal  difficulty  in  solving  (2.1)  stems 
from  its  nonconvexity,  implying  that  direct  solutions, 
even  through  dynamic  programming  are  largely  out  of 
reach.  A  further  difficulty  occurs  if  multiple  optimal 
solutions  are  present  at  one  or  more  levels  in  the 
hierarchy.  This  may  lead  to  the  situation  where  not  all 
the  elements  in  a  lower  level  player's  rational  reaction 
set  (this  set  is  defined  in  Appendix  B)  will  actually 
provide  the  maximum  payoff  to  some  higher  level  player. 
In  this  case,  one  or  more  feasible  regions,  though 
perhaps  bounded,  will  not  be  closed  (e.g.,  see  Bard  and 
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Falk  1982a),  so  an  exact  solution  may  not  be  attainable. 
This  will  make  it  necessary  to  introduce  the  concept  of 
£ -optimality  (see  Basar  and  Olsder  1982,  Chang  and  Luh 
1982b) . 

Throughout  the  dissertation  a  number  of  assumptions 

and  additional  notational  conventions  are  adopted  to 

simplify  the  presentation.  First,  the  vector  (x,y)  and 

1  2 

the  function  (F,f)  are  substituted  for  (x  ,x  )  and 
1  2 

(f  ,f  )  when  only  two  players  are  involved  (that  is,  a 
single  leader  and  follower).  Next,  it  is  assumed  that 
X*  (1=1,..., p)  are  open  subsets,  so  they  are  suppressed 
in  the  formulations.  Finally,  the  set  S  is  given  the 
explicit  form  (x  :  g(x)  <  0}  where  g(x)  is  an  m- 
dimensional  vector-valued  function.  Thus,  the  linear 
bilevel  programming  problem  (BLPP)  will  be  written  as: 


1  2 

Max  F(x,y)  =cx+cy  where  y  solves 


Max  f(x,y)  =  d1x  +  d2y 


subject  to 


Ax  +  By  <  b 
x  >  0,  y  >  0 


(2.2a) 


(2.2b) 


(2.2c) 
(2. 2d) 


where  it  should  be  noted  that  the  term  d  x  in  the 


follower's  objective  function  can  be  omitted  without 
affecting  the  solution,  and  g(x)  <  0  is  represented  by 


.jvt-wi: 
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(2.2c)  and  (2. 2d).  In  the  next  section  relevant 
background  material  is  presented  along  with  current 
developments . 

2 . 4  The  Linear  BLPP 

The  first  advances  toward  a  solution  of  the  BLPP 
were  made  by  Falk  (1973)  who  studied  the  general  linear 
max-min  problem.  His  algorithm  was  based  on  branch  and 
bound  techniques,  and  required  the  solution  of  a  number 
of  linear  programs  at  each  iteration.  Soon  after,  Gallo 
and  Ulkucu  (1977)  devised  a  solution  to  the  bilinear 
programming  problem  which  is  identical  to  Falk’s 
formulation  when  the  latter's  constraint  region  is 
disjoint  in  the  x  and  y  spaces.  While  their  algorithm 
was  based  on  optimality  conditions  associated  with  the 
dual,  others,  including  Konno  (1976),  have  developed 
cutting  plane  approaches.  More  recently,  Al-Khyyal  and 
Falk  (1983)  have  addressed  the  jointly  constrained 
biconvex  programming  problem  and  have  implemented  an 
algorithm  for  some  special  cases. 

Building  on  earlier  work  in  parametric  and 
nonconvex  programming  (e.g.,  see  Gehner  1974,  Vaish  and 
Shetty  1976,  Yu  and  Zeleny  1975),  Bard  (1984)  has  shown 
that  the  linear  BLPP  is  equivalent  to  maximizing  the 


* 


function  F  over  a  constraint  region  composed  of 
connected  edges  and  hyperplanes  of  the  polyhedron  S. 

This  result  confirmed  the  inherent  nonconvexity  of  the 
linear  MLPP  and  raised  the  possibility  of  local  optima 
(see  Bialas  and  Karwan  1982,  Candler  and  Townsley  1982 
as  well).  However,  it  was  also  shown  that  the  global 
optimum  occurred  at  a  vertex  of  S,  thereby  suggesting  an 
extreme  point  search  procedure,  perhaps  within  the 
framework  of  branch  and  bound. 

Previously,  Candler  and  Townsley  (1982)  proposed  an 
implicit  enumeration  scheme  that  generated  global 
information  at  each  iteration.  This  information  defined 
a  set  of  necessary  conditions  that  was  then  used  to 
avoid  returning  to  any  previously  explored  bases.  They 
observed  that  once  an  optimal  basis  to  the  follower's 
problem  was  obtained,  changing  the  value  of  x  might 
affect  its  feasibility  but  not  its  optimality. 

Therefore,  through  pivoting  operations,  it  was  possible 
to  iteratively  generate  and  test  adjacent  extreme  points 
for  feasibility  and  local  optimality.  Bialas  and  Karwan 
(1982)  also  pursued  this  idea  while  concurrently 
developing  the  "Kth-Best"  Algorithm.  The  latter  begins 
by  generating  an  upper  bound  on  F  by  solving 


to  obtain  the  "high  point"  (x',y')  of  S.  This  point  is 
then  checked  for  feasibility  by  solving  the  follower's 
problem  with  x  fixed  at  x'.  If  the  resultant  value  of  y 
is  equal  to  y',  the  algorithm  terminates  with  (x1 ,y' )  as 
the  global  optimum;  if  not,  all  extreme  points  adjacent 
to  (x',y')  are  checked  for  feasibility,  and  the  one  that 
produces  the  largest  value  for  F  is  declared  the 
solution  so  long  as  no  other  infeasible  adjacent  extreme 
point  yields  a  larger  payoff.  If  the  test  for 
optimality  is  not  met,  the  next  level  of  adjacent 
extreme  points  is  checked  and  so  on. 

A  second  category  of  techniques  for  solving  the 
BLPP  is  based  on  direct  conversion  of  this  problem  into 
a  standard  nonconvex  program.  Working  with  the  Kuhn- 
Tucker  conditions  of  the  follower's  problem,  Bard  and 
Falk  (1982a)  developed  the  following  equivalent 
representation : 


Via '.*#■*. 


it*  y*'  i 


1  2 

Max  F(x,y)  =  c  x  +  c  y 
x,y  ,u 


subject  to 


uB  =  d 


u(b  -  Ax  -  By)  =  0 
Ax  +  By  <  b 
x  >  0 ,  y  >  0 ,  u  >  0 


(2.3a) 


(2.3b) 
(2.3 c) 
(2.3d) 
(2.3e) 


where  ueR  .  They  solved  this  problem  by  converting 
(2.3c)  into  a  piecewise  linear,  separable  function  and 
then  applying  a  standard  branch  and  bound  algorithm  (see 
Grotte  1976).  The  conversion  requires  the  addition  of 
the  vector  zeRm  to  the  decision  space,  ultimately 
increasing  its  order  to  2m+n.  The  dimensions  of  the 
problem  that  is  finally  solved,  therefore,  grows 
linearly  as  the  number  of  constraints  in  S  increases 
while  the  accompanying  branch  and  bound  tree  grows 
exponentially . 

Bialas,  Karwan,  and  Shaw  (1980)  developed  a  second 

approach  to  (2.3)  based  on  parametric  complementary 

pivoting  (see  also  Bialas  and  Karwan  1984).  By  adding 

the  constraint  z  =  b  -  Ax  -  By  to  (2.3),  where  zeRm,  and 

then  eliminating  (2.3c),  they  solve  the  resultant  linear 

program  with  the  further  restriction  that  for  each  i,  if 

u.  is  in  the  basis  then  z.  must  be  excluded, 
i  l 
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Formulation  and  operational  requirements  include  the 

addition  of  approximately  3m  variables  to  the  original 

decision  space,  a  parametric  constraint  of  the  form  c1x 
2 

+  c  y  >  t,  and  the  ability  to  store  previously  explored 
bases.  Finally,  Fortuny-Amat  and  McCarl  (1981)  solved 
(2.3)  by  converting  the  complementarity  term  (2.3c)  into 
2m  mixed  integer  constraints  with  the  addition  of  m 
zero-one  variables. 

2.5  The  Linear  MLPP 

Work  on  the  linear  MLPP  has  progressed  at  a 
slightly  slower  pace.  Bard  (1982)  developed  the 
geometric  properties  for  the  three  level  programming 
problem  (TLPP)  and  proposed  a  grid  search  algorithm  that 
begins  by  setting  up  a  parameterized  linear  program 
whose  solution  coincides  with  the  linear  version  of 
(2.1).  Although  the  approach  works  quite  well  for  the 
BLPP  (see  Bard  1983b),  it  will  not  solve  all  problems 
and  may  further  be  limited  by  the  bookkeeping  burden 
imposed  by  the  prospect  of  multiple  optimal  solutions. 

A  second  approach  offered  by  Wen  (1981)  combines 
the  "K^-Best"  Algorithm  to  identify  initial  trial 


points,  and  the  complementary  pivot  algorithm  to  test 
for  bilevel  optimality.  Although  this  procedure  seems 


to  work  satisfactorily  for  most  problems,  its 
computational  load  grows  geometrically  with  the  number 
of  constraints.  In  addition,  the  usefulness  of  the 
complementary  pivot  algorithm  may  be  limited  when 
degeneracy  is  present . 

Bard  and  Falk  (1982b)  developed  the  rational 
reaction  sets  for  each  of  the  players  while  expanding  on 
the  geometric  properties  of  the  linear  MLPP. 
Subsequently,  first  order  necessary  conditions  were 
derived  and  the  problem  was  recast  as  a  standard 
nonlinear  program.  A  cutting  plane  algorithm  employing 
a  vertex  search  procedure  at  each  iteration  was  proposed 
to  solve  the  linear  3-level  case,  but  has  not  yet  been 
fully  automated.  Limited  testing  suggests  that  problems 
with  up  to  100  variables  and  100  constraints  are  well 
within  the  manageable  range.  An  Important  consequence 
of  this  work  was  that  individual  sets  of  dual  variables 
were  identified  for  each  level  in  the  system.  In 
accordance  with  their  usual  economic  interpretation,  it 
may  be  possible  to  develop  a  decomposition  algorithm  to 
solve  large-scale  problems. 


19 


2 . 6  The  Nonlinear  MLPP 

To  date,  only  a  few  specialized  versions  of  the 
nonlinear  MLPP  have  been  addressed  with  any  degree  of 
success.  Bard  and  Falk  (1982a)  Investigated  the 
"convex"  BLPP  where  the  follower's  problem  is  a  convex 
program.  By  assuming  that  f  and  -g  were  both  smooth  and 
concave  In  y  for  x  fixed,  and  that  the  regularity 
conditions  held,  they  were  able  to  reformulate  the  BLPP 
as  a  mathematical  program: 

Max  F ( x , y )  (2.4a) 

x,y,u 

subject  to  vyf(x,y)  -  uvyg(x,y)  =  0  (2.4b) 

ug(x,y)  =  0  (2.4c) 

g(x,y)  <  0  ( 2 . 4d) 

x  >  0  y  >  0,  u  >  0  (2.4e) 

Global  solutions  under  the  further  assumption  of 
function  separability  were  obtained  by  using  an  existing 
routine.  A  second  approach  to  the  BLPP  without  regard 
to  convexity  was  recently  offered  by  Bard  (1983a).  The 
algorithm  was  based  on  a  second  set  of  necessary 
conditions  developed  by  Bard  (1984)  for  the  leader's 
problem. 
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Other  work  on  the  multilevel  problem  has  been 
primarily  limited  to  variants  of  the  Stackelberg  game 
with  strictly  convex  quadratic  cost  functions  and  linear 
equality  constraints,  in  the  context  of  optimal  control 
(e.g.,  see  Basar  and  Selbuz  1979,  Tolwinski  1981). 

Luh,  Chang,  and  Ning  (1982)  have  also  obtained  some 
results  for  the  discrete  decision  variable  case,  while 
Cruz  (1978)  has  extended  Stackelberg  concepts  to 
multilevel  formulations. 

Finally,  a  discussion  of  the  the  MLPP  is  related  to 
bimatrix  games  (see  Lemke  and  Howson  1964).  Nonlinear 
programs  with  optimization  problems  in  the  constraints 
can  be  found  in  Bard  and  Falk  (1982a). 


CHAPTER  3 


NOTATION,  DEFINITIONS,  AND  THEOREMS 


3 . 1  Introduction 

Chapter  3  presents  the  notation  which  will  be  used 

in  the  remainder  of  the  dissertation.  Definitions  of 

key  concepts  and  theorems  necessary  to  the  development 

of  the  algorithms  are  also  presented.  Before  presenting 

this  information,  the  BLPP  will  be  restated. 

1  2 

Max  F(x,y)  =  c  x  +  c  y  where  y  solves  (3.1a) 

x 

Max  f(x,y)  =  d1x  +  d2y  (3.1b) 

Y 

subject  to  Ax  +  By  <  b  (3.1c) 


x,  y  >  0  (3. Id) 

3 . 2  Notation 

In  the  development  it  will  be  assumed  that  both  the 
leader  and  follower  have  full  knowledge  of  each  other's 
objective  function,  and  that  no  cooperation  takes  place. 


nv 


4**  a1**' 


This  eliminates  the  use  of  side  payments,  and  opens  up 
the  possibility  of  obtaining  dominated  solutions  in  the 
Pareto-optimal  sense  (Yu  1974). 

Reference  to  the  following  notation  will  be  made 
throughout  the  development . 

BLPP  Constraint  Region: 

fl  =  {  ( x ,  y )  |  Ax  +  By  <  b) 


Follower's  Feasible  Region  for  xcX  fixed: 
Q(x)  =  (y€Y  |  Ax  +  By  <  b) 


Projection  of  fl  onto  R  : 


r  =  { x€X  |  3  y€Y  such  that  Ax  +  By  <  b) 


Follower's  Rational  Reaction  Set: 

'P(x)  =  <y  |  y  solves:  max[f(x,y)  :  yeQ(x)]} 


Inducible  Region: 


IR  =  { (x,y )  |  xer,  y6«(x)) 


3.3  Definitions 


Using  the  above  notation,  two  definitions  can  be 


■: 

l 

y 

y 


given. 
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Definition  3.1:  If  ygffx),  then  y  is  said  to  be  optimal 
with  respect  to  x.  Such  a  pair  as  (x,y)  will  be  called 
feasible . 

Definition  3.2:  A  point  (x*,y*)  is  said  to  be  an 
optimal  solution  to  the  BLPP  if 

(a)  (x*,y*)  is  feasible; 

(b)  for  all  feasible  pairs  (x,y)€G,  F(x*,y*)  >  F(x,y) . 

In  order  to  ensure  that  the  problem  is  well 
defined,  three  additional  requirements  are  imposed:  1)  G 
is  nonempty,  2)  T(x*)  is  a  singleton  for  x*  optimal,  and 
3)  for  each  decision  taken  by  the  leader,  the  follower 
has  a  feasible  response;  that  is,  G(x)  *  <p .  The 
rational  reaction  set,  V(x),  denotes  these  responses, 
while  the  inducible  region,  IR,  represents  the  set  over 
which  the  leader  may  optimize.  This  implies  that  the 
BLPP  can  be  written  as 

Max(F{x,y)  :{x,y)€lR)  (3.2). 


3 . 4  Theorems 

The  following  theorems  are  taken  from  Bard  (1984), 
and  they  show  that  when  the  linear  BLPP  (3.1)  is 
restated  as  a  standard  mathematical  program  in  the  form 


Uviumi  m wmm  i umm  uvww  p? 


of  (3.2),  the  inducible  region  is  comprised  of  connected 


faces  of  a. 

Theorem  3.1:  The  linear  BLPP  (3.1)  is  equivalent  to 
1  2 

maximizing  c  x  +  c  y  over  a  feasible  region  comprised  of 
a  piecewise  linear  equality  constraint. 

1  2 

Because  a  linear  function  c  x  +  c  y  is  being  maximized 

1  2 

over  IR,  and  because  c  x  +  c  y  is  bounded  above  on  Q, 
the  following  can  be  concluded. 

Corollary  3.1:  The  solution  to  the  linear  BLPP  occurs 
at  a  vertex  of  the  inducible  region. 

The  fact  that  a  vertex  solution  results  was  also 

postulated  by  Bialas  and  Karwan  (1984)  who  noted  that 

(3.1)  could  be  written  equivalently  as 

1  2 

Max[c  x  +  c  y:  (x,y)  €  [IR]], 
where  [IR]  is  the  convex  hull  of  IR.  However,  [IR]  is 
not  equivalent  to  SI ,  but  in  the  next  theorem,  it  is 
shown  that  the  solution  vertex  of  IR  is  also  a  vertex  of 

n. 


The  pure  linear  0-1  bilevel  programming  problem 


(BLPP)  takes  the  following  form  where  F(x,y)  represents 


the  leader's  objective  function,  f(x,y)  represents  the 


follower's  objective  function,  x  is  an  n  -dimensional 


vector  which  represents  the  binary  variables  controlled 


by  the  leader,  and  y  is  an  n  -dimensional  vector  which 


represents  the  binary  variables  controlled  by  the 


follower.  The  problem  is: 


1  2 

Max  F(x,y)  =  c  x  +  c  y  where  y  solves 
x 


(4.1a) 


Max  f(x,y)  =  d*x  +  d2y 


(4.1b) 


subject  to:  Ax  +  By  <  b 


(4.1c) 


x  €  X  =  (Xj  binary | j=l 
y  €  Y  =  { y j  binary | j=l 


(4. Id) 


( 4 . le ) 


"'ll 
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where  c,d,c,d,A,B,  and  b  are  as  defined  in 
Section  1.1,  and  each  is  an  array  of  integer  constants. 
It  should  be  noted  that  the  term  d1x  in  the  follower's 
objective  function  can  be  omitted  without  affecting  the 
solution  of  the  BLPP .  This  is  true  because  once  the 
leader  has  made  his  decision,  the  follower's  problem 
becomes  one  in  which  the  variables  controlled  by  the 
leader  are  parameters . 

4 . 2  The  Parametric  Formulation  of  the  0-1  BLPP 

The  BLPP  with  integer  variables  presented  above 
cannot  be  solved  using  the  techniques  of  integer 
programming.  The  key  to  solving  (4.1)  is  in  the 
recognition  that  any  solution  to  (4.1)  must  be  in  the 
follower's  rational  reaction  set,  'P(x).  By  limiting  the 
search  to  this  set  while  constantly  seeking  improvement 
in  the  leader's  objective  function,  good  points  in  the 
inducible  region  can  be  uncovered.  This  is  achieved  by 
formulating  and  iteratively  reiving  the  following 
parameterized  integer  program  derived  from  (4.1). 


aaaaaa  aaaaa  aaaaa  mmsa  fiaaaa  ttaa a 
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Max  f(y)  =  d2y 
x,Y 

(4.2a) 

subject  to  : 

Ax  +  By  <  b 

(4.2b) 

F(x,y) 

1,2^ 

=  cx  +  cy>a 

1 

n 

(4.2c) 

S  x.  >  p 
i  =  l 

(4. 2d) 

xeX,  yeY 

(  4 . 2e ) 

where  a  and  p  are  right-hand  side  parameters  initially 
taken  as  -co  and  0,  respectively.  In  problem  (4.2),  the 
follower's  objective  function  with  the  d1x  term  omitted 
is  the  objective  function,  and  the  leader's  objective 
function  becomes  the  parameterized  constraint  (4.2c). 
This  constraint  forces  a  tradeoff  between  the  two 
objective  functions  ( cf .  Roodman  1972,  Schrage  and 
Wolsey  1985),  while  the  parameterized  constraint  (4. 2d) 
places  a  restriction  on  the  sum  of  the  variables 
controlled  by  the  leader.  Constraint  (4. 2d)  is  employed 
to  prevent  stalling  in  the  iterative  algorithm. 

Proposition  4.1  defines  when  a  point  is  in  the 
inducible  region  (IR)  or  feasible  region  of  problem 


(4.1)  . 


i'*  *'4  •*§  i'l  I't.i’i  i  i  ».|  dj  <|«  ‘i*  ***  “i  Vi  **t 


Proposition  4.1:  Let  (x,y)  solve  problem  (4.2) 

(x,y)  e  IR  if 


Then 


1  -  2  2 

c  x  +  Z  .(minCc.,0]  -  c.)  - 

jeJ1  3  3 

2  2 

Z  { max [  c  . ,  0 )  -  c . )  >  a, 

j  eJu  3  3 


1  -  2 
where  J  =  UlYj  =  1*  j  =  l . n  )  and 

J°  =  ( j I Yj  =  0,  j  =  l - ,n2}  . 


If  (x,y)  solves  (4.2),  one  way  to  determine  if  (x,y)  is 

in  the  IR  of  (4.1)  is  to  fix  x  at  x  and  solve  the 

resulting  problem  to  determine  if  the  solution  is  y. 

However,  Proposition  4.1  defines  a  test  which  may  be 

used  to  check  if  (x,y)  is  in  the  IR  of  (4.1).  To  apply 

Proposition  4.1,  calculate  the  value  of  c1x.  Then 

2 

adjust  this  value  by  subtracting  |c^|  for  each  j, 

2  2  2 
j“l,  .  .  .  ,n  ,  such  that  c^  >  0  and  y^.  =  1  or  c^.  <  0  and  y^ 


Although  Proposition  4.1  is  valid  when  alternate 
optima  exist,  if  ¥(x*)  is  not  a  singleton  as  required, 
different  values  of  y  in  ?(x*)  may  produce  different 
objective  function  values,  F(x*,y),  for  the  leader. 
Basar  and  Selbuz  (1979)  address  this  ambiguity  by 
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further  defining  what  is  meant  by  a  solution  of  the 
game;  alternatively,  Bard  and  Falk  (1982)  propose 
solving  a  separate  subproblem  to  test  for  the  condition 
after  their  algorithm  converges.  Unfortunately, 
Proposition  4.1  did  not  provide  a  strong  test  for 
determining  when  a  point  was  in  the  IR.  Because  of 
this,  it  is  not  included  in  the  algorithm. 

4 . 3  The  Algorithm 

The  algorithm  presented  below  applies  a  branch  and 
bound  procedure  to  find  the  solution  of  (4.1).  The 
branch  and  bound  scheme  is  a  depth  first  approach 
centering  on  the  leader's  decision  variables  and, 
applied  to  problem  (4.2),  is  used  to  find  the  optimal 
solution  of  (4.1).  The  basic  idea  is  to  successively 
examine  points  that  satisfy  the  constraints  of  (4.2), 
fix  the  variables  controlled  by  the  leader  at  their 
corresponding  values,  and  then  resolve  (4.2)  to  obtain  a 
new  point  in  the  inducible  region.  By  adjusting  a  and  p 
at  each  iteration,  the  algorithm  steadily  increases  the 
leader's  objective  function  until  the  problem  becomes 
infeasible . 

A  point,  (xk,yk)  e  ({0,1}  *  (0,l))n  +n  ,  is  in  the 
inducible  region  of  the  0-1  BLPP  when  it  satisfies  two 


conditions.  The  first  condition  is  the  constraint 
k  k 

(4.2b),  Ax  +  By  <  b,  must  be  satisfied.  The  second 

k  1 

condition  is  for  x  fixed,  there  does  not  exist  a  yJ 

such  that  Axk  +  By1^  <  b  and  ffx^y^)  >  f(xk,yk). 

Solving  (4.2)  readily  yields  feasible  solutions  of  (4.1) 

when  constraints  (4.2c)  and  (4. 2d)  are  relaxed  and  x  is 

fixed.  The  algorithm  exploits  this  property  of  (4.2). 

Notationally ,  let  W  =  (1,...,^).  Each  path  in 

the  branch  and  bound  tree  will  correspond  to  an 

assignment  of  either  x^  =  0  or  x^  *  1  for  jeWfc  £  W,  and 

thus  identifies  a  partial  solution  for  the  variables 

controlled  by  the  leader.  The  index  set  of  the  assigned 

variables  controlled  by  the  leader  is  denoted  by  W^. 

Now  let 

s+  =  ( j | j  e  Wk  and  Xj  =  1 ) 
sk  =  < J I  3  €  Wk  and  x^  =  0} 
s°  =  (31 J  *  wk> 

A  completion  of  is  an  assignment  of  binary  values  to 
the  free  variables  controlled  by  the  leader  and  is 
specified  by  the  index  set  S^.  The  algorithm  does  not 


specifically  assign  values  to  the  variables  controlled 
by  the  follower.  These  variables  are  always  free  and 
are  assigned  values  which  maximize  the  value  of  the 
follower's  objective  function  in  (4.2).  A  flow  chart  of 
the  algorithm  is  presented  in  Figure  4.1. 

Step  0:  (Initialization)  Put  k=0 ,  S*  =  <f> ,  =  <#> ,  = 

{l,...^1}.  Put  a  =  -oo,  p  =  0,  and  F_  =  -oo . 

Step  1:  (Iteration  k)  Set  x^  =  1  for  j  €  Sfc  and  x^  =  0 

for  j  €  S^.  For  the  current  values  of  a  and  p 

find  a  feasible  solution  of  (4.2).  If  a 

feasible  solution  exists  put  k*-k+l ,  label  the 
lc  lc 

solution  (x  ,y  )  and  go  to  Step  2;  otherwise  go 
to  Step  5. 

1 r 

Step  2:  (Bounding)  Fix  x  at  x  ,  a  at  -oo,  p  at  0  and 

lc  lc 

solve  (4.2)  to  get  a  point  (x  ,y  ).  Compute 
F { xk , yk )  and  put  F_  =  max  [  F_,  F  ( xk ,  yk )  ]  . 


Jr  1 

Step  3:  (Branching)  For  each  =  1,  j=l,...,n  ,  such 
that  j€Sk,  add  a  live  vertex  to  the  branch  and 
bound  tree,  put  s£  <-  S*  u  {j},  S°  <-  S°  \  {j}, 

Sk  «-  Sk-  The  vertices  are  added  to  the  branch 
and  bound  tree  in  a  depth  wise  fashion. 

Step  4:  Let  a  =  F  +  1.  Let  p  =  1  +  I  x.  . 

j€Sk 

Go  to  Step  1 . 

Step  5:  (Backtracking)  If  no  live  vertex  exists,  go  to 
Step  6.  Otherwise  branch  to  the  newest  live 
vertex  and  update  Sk,  S~,  and  S®.  Put  p=0  and 
go  to  Step  1 . 

Step  6:  (Termination)  If  F  =  -oo,  there  is  no  feasible 
solution  to  (4.1).  Otherwise,  declare  the 
feasible  point  associated  with  F_  the  optimal 
solution . 

Step  1  is  designed  to  find  a  new  point  which  is 
potentially  bilevel  feasible.  At  Step  1,  it  is  not 
necessary  to  solve  (4.2)  to  optimality.  Step  1  requires 
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a  feasible  but  not  necessarily  optimal  solution  of 
(4.2).  However,  if  a  feasible  solution  of  (4.2)  exists, 
it  must  be  uncovered.  At  Step  2,  constraints  (4.2c)  and 
(4. 2d)  are  relaxed,  and  (4.2)  is  solved  for  a  fixed 
vector  of  variables  controlled  by  the  leader.  The 
solution  is  in  the  inducible  region,  and  if  an 
improvement  results,  the  incumbent  is  replaced. 
(Alternatively,  Proposition  4.1  could  be  invoked,  but 
this  would  require  solving  (4.2)  to  optimality.) 
Branching  occurs  at  Step  3  where  S+,  S®,  and  S~  are 
updated.  At  Step  3,  live  vertices  are  also  added  to  the 
branch  and  bound  tree.  The  live  vertices  are  added  in  a 
depth  wise  manner.  At  Step  4 ,  a  is  set  to  the  current 
best  known  solution  of  (4.1)  and  is  incremented  by  one. 
This  guarantees  that  when  the  algorithm  returns  to  Step 
1,  if  a  feasible  solution,  (xk,yk) ,  of  (4.2)  is  found, 
it  will  satisfy  F(xlC,yk)  >  F_.  Also  at  Step  4 ,  p  is  set 
to  the  stun  of  the  variables  controlled  by  the  leader  and 
is  incremented  by  one.  This  insures  that  at  least  one 
element  of  the  set  S^  at  iteration  k  has  a  value  of  1, 
thus  providing  a  branching  variable  at  Step  3.  If  this 
operation  is  not  included,  the  algorithm  might  return  to 
the  current  point  and  hence  stall. 
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Proposition  4.1  suggests  that  it  may  not  be 
necessary  to  solve  problem  (4.2)  at  Step  2;  however,  a 
tradeoff  exists.  If  the  optimum  is  found,  the  need  to 
solve  (4.2)  to  optimality  at  Step  1  is  obviated.  Any 
feasible  solution  can  be  used  at  Step  2  to  find  a  new 
point  in  the  inducible  region. 

If  problem  (4.2)  is  infeasible  at  Step  1,  the 
algorithm  proceeds  to  Step  5  where  the  backtracking 
operation  is  performed.  To  facilitate  bookkeeping,  the 
path  Pfc  in  the  branch  and  bound  tree  can  be  concisely 
represented  by  an  fc -dimensional  vector  where  fc  is  the 
current  depth  of  the  tree.  The  order  of  the  components 
is  determined  by  their  "level"  in  the  tree.  Indices 
only  appear  in  the  vector  Pfc  if  they  are  in  S*  or  Sfc  and 
appear  underlined  if  they  are  in  S^.  Because  the 
algorithm  always  branches  to  1  first,  the  backtracking 
operation  may  be  accomplished  by  finding  the  rightmost 
nonunderlined  element  of  P^,  underlining  it,  and  erasing 
all  entries  to  the  right.  The  newly  underlined  entry  is 
deleted  from  s£  and  added  to  S^;  the  erased  entries  are 
deleted  from  S^  and  added  to  S^.  If  this  procedure  is 
followed,  the  optimal  solution  of  the  BLPP  cannot  be 
overlooked.  This  leads  to  the  following  result. 


mmmmm 


wunvwwtr 


1 


37 


Proposition  4.2:  Under  the  uniqueness  assumption  stated 
in  Chapter  3,  the  algorithm  terminates  with  the  optimal 
solution  of  the  BLPP  (4.1). 

Proof  -  The  algorithm  implicitly  looks  at  all 
combinations  of  x  at  Step  3  and  5;  the  subproblem  solved 
at  Step  2  guarantees  that  all  incumbent  solutions  are  in 
the  inducible  region.  ■ 

4 . 4  Examples 

An  example  is  taken  from  Bard  (1984)  and  is  used  to 
demonstrate  how  the  algorithm  works.  Coincidently ,  it 
illustrates  two  interesting  features  of  the  solution  of 
the  integer  linear  BLPP. 

Example  4.1 

Max  F(x,y)  =  -x  -  y,  where  y  solves 
x>0 

Max  f(x,y)  =  5x  +  y 
y>0 

subject  to  -x  -  y/2  <  -2 

-x/4  +  y  <  2 

x  +  y/2  <  8 

x  -  2y  <  4 


taaaaaa  aa aaa  aaaai  aama. 
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The  optimal  solution  of  Example  4.1  without  regard  to 
integrality  is  (x  ,y  )  =  (8/9,20/9)  with  F  =  -28/9.  The 
graph  of  the  feasible  region,  0,  is  shown  in  Figure  4.2, 
and  it  indicates  that  x  <  8  and  y  <  4.  If  x  and  y  are 
restricted  to  integer  values,  the  example  can  be 
reformulated  as  a  linear  BLPP  with  0-1  variables  where 
x  =  x1+2x2+4x3  and  y=  y^  2y2 .  The  example  with  binary 
variables  is  restated  as  Example  4.2. 

Example  4 . 2 

Max  F(x,y)  =  -x^^  -  2x2  -  4xg  -  -  2y2 ,  where  y  solves 

Max  f (x,y )  =  5x1  +  10x2  +  20xg  +  y1  +  2y2 
subject  to 

-2x.1  -  4x2  -  8x3  -  yx  -2y2  <  -4 
-Xj  -  2x2  -  4x3  +  4y1  +  8y2  <  8 


2x1  +  4x2  +  8x3  +  y:  +  2y2 


<  16 


Xl  +  2X2  +  4x3  -  2Yl  -  4y2  <  4 


x  ,  x2,  x3,  y1#  y2  =  0  or  1 


Example  4.2  can  now  be  restated  in  the  form  of  (4.2). 


Max  y  +  2y 

x,Y 

subject  to 


"2*1  -  4x2  "  8X3  “ 

Yi  -2Y2 

< 

-4 

~X1  “  2x2  '  4X3  + 

4Yt  +  8y2 

< 

8 

2xi  +  4x2  +  8x3  + 

Yl  +  2Y2 

< 

16 

Xx  +  2x2  +  4x3  - 

2Yj  -  4y2 

< 

4 

-*i  -  2x2  “  4X3  " 

Yl  -  2y2 

> 

a 

*1  + 

x2  +  X3 

> 

P 

Xj^ ,  x2,  x3,  y1#  y2  =  0  or  1 

The  first  few  steps  of  the  algorithm  are  outlined  below. 
For  the  sake  of  brevity,  the  integer  representation  of 
the  binary  points  is  presented. 

After  initialization  at  Step  0,  the  algorithm  finds 
the  point  (4,3)  at  Step  1  which  is  confirmed  to  be  in 
the  inducible  region  at  Step  2.  Thus,  =  -7,  S*  =  (3), 
S8  =  (1,2),  a  =  -6,  and  3*2.  Solving  again  at  Step  1 
yields  the  point  (5,1).  At  Step  2,  (x2,y2)  =  (5,3)  and 


2*2  + 

F(x  ,  y  )  =  -8,  so  remains  -7.  Updating  gives  S2  = 

{3,1},  S°  =  {2},  a  =  -6,  and  3=3.  At  Step  1,  no 

feasible  solution  is  found,  so  the  algorithm  goes  to 

Step  5  and  backtracks  giving  S*  =  {3},  S~  =  <1),  S2  = 

{2},  a  =  -6,  and  3=0.  Returning  to  Step  1,  the 

calculations  continue  until  convergence  occurs  at  the 

11th  iteration. 

*  * 

The  optimal  solution  of  Example  4.2  is  (x  ,y  )  = 
(1,2)  with  F=-3.  The  corresponding  branch  and  bound 
tree  is  shown  in  Figure  4.3.  During  execution,  the 
algorithm  returns  to  Step  1  thirteen  times  in  an  attempt 
to  improve  upon  the  incumbent.  Subsequently,  seven 
subproblems  are  solved  at  Step  2  to  find  new  points  in 
the  inducible  region.  If  problem  (4.2)  were  completely 
solved  at  Step  1,  however,  it  would  not  have  been 
necessary  to  solve  three  of  these  seven  subproblems. 

With  regard  to  individual  outcomes,  note  that  the 
leader  does  better  when  the  variables  are  restricted  to 
integer,  rather  than  continuous,  values.  Although  this 
observation  cannot  be  generalized,  it  arises  here 
because  the  follower's  feasible  region  D(x)  is  somewhat 
reduced  by  the  integer  requirements.  When  the  first 


term  in  f(x,y)  is  omitted,  the  opposite  is  true  for  the 
follower . 

A  second  inference  that  can  be  drawn  from  the 
example  concerns  the  nature  of  the  solution.  In 
particular,  note  that  when  compared  to  the  optimum 
(1,2),  the  point  (2,0)  provides  better  outcomes  for  both 
players  but  is  not  in  the  inducible  region.  That  is,  if 
the  leader  plays  x=2 ,  the  follower  chooses  ys=2 ,  thereby 
degrading  the  leader's  payoff  by  1  unit.  Thus, 
solutions  to  the  integer  BLPP  are  not  necessarily 
Pareto-optimal.  (If  the  first  term  in  f(x,y)  is 
dropped,  a  slight  alteration  in  the  problem  would  be 
required  to  demonstrate  this  result.  Although  the  first 
term  in  f(x,y)  does  not  affect  the  solution  of  the  BLPP, 
it  does  affect  the  value  of  the  follower's  objective 
function. ) 

4 . 5  Computational  Experience 

A  variety  of  randomly  generated  problems  are  solved 
using  the  algorithm.  The  problems  are  generated  using  a 
random  number  generator  based  on  Knuth  (1969).  In  the 
randomly  generated  problems,  all  constraints  are 


inequalities  with  positive  right-hand  sides  which  vary 


between  0  and  45.  The  coefficients  of  the  A-  and  B- 


matrices  range  from  -10  to  28  with  approximately  40 
percent  of  the  nonzero  coefficients  negative.  The 
coefficients  of  the  leader's  and  follower's  objective 
functions  also  assume  both  positive  and  negative  values. 
The  number  of  constraints  in  each  problem  was  set  to  0.4 
times  the  number  of  variables  in  the  problem,  and  the 
density  of  the  A-  and  B-matrices  is  approximately  0.475. 

The  algorithm  is  written  in  FORTRAN  77  on  an  IBM 
3081D.  A  Balas-type  algorithm  similar  to  the  one 
described  by  Garfinkel  and  Nemhauser  (1972)  is  used  to 
solve  the  0-1  problem  at  Steps  1  and  2.  In  their 
presentation,  Garfinkel  and  Nemhauser  suggest  several 
tests  which  may  reduce  the  enumeration  at  the  expense  of 
additional  calculation.  The  only  test  included  in  the 
algorithm  is  Test  1  which  checks  for  feasibility  of  a 
completion.  Tests  2-4  were  evaluated  but  failed  to 
provide  an  improvement  in  performance.  The  FORTRAN  code 
of  the  additive  algorithm  is  based  on  a  code  written  by 
Jensen  ( 1983 ) . 

In  all,  10  problems  were  run  for  each  case  where  a 
case  is  defined  by  the  total  number  of  variables  and  the 
number  of  variables  controlled  by  the  follower.  The 
information  presented  in  Table  4.1  is  the  average  for 


t  - 


45 

each  case.  CPU  time  is  given  in  seconds.  'Iterations- 
Step  1'  refers  to  the  number  of  times  Step  1  of  the 
algorithm  is  performed  and  represents  the  number  of 
times  the  algorithm  searches  for  a  feasible  solution  of 
(4.2).  In  a  similar  fashion,  1 Iterations-Step  2'  refers 
to  the  number  of  times  the  algorithm  attempts  to  find  an 
improved  feasible  solution  of  the  BLPP  at  Step  2.  'No. 
of  Verts'  indicates  the  number  of  vertices  in  the  branch 
and  bound  tree  created  by  the  algorithm.  'Optimal 
Solution  (Vert)'  is  the  vertex  in  the  branch  and  bound 
tree  at  which  the  optimal  solution  of  the  BLPP  is 
uncovered . 

As  expected,  the  CPU  time  grows  exponentially  with 
the  size  of  the  problem  but  seems  to  be  independent  of 
the  way  the  variables  are  partitioned.  Nevertheless, 
the  averages  given  in  Table  4.1  do  not  reveal  the  large 
differences  that  were  observed  among  problems  of 
equivalent  size.  As  an  example,  the  greatest  range  in 
CPU  time  appeared  for  those  problems  containing  45 
variables  where  15  are  controlled  by  the  follower. 

Here,  the  longest  CPU  time  is  757  seconds  while  the 
shortest  is  less  than  3  seconds.  Eliminating  these  two 
extremes  and  redoing  the  calculations  gives  an  average 
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TABLE  4.1:  COMPUTATIONAL  RESULTS 


No.  of 
Variables 
(n‘  +n*  ) 

Follower 
Variables 
(n*  ) 

CPU 

Time 

(sec) 

Iterations 
Step  Step 

1  2 

No. 

of 

Verts 

Optimal 
Solution 
(Vert ) 

15 

5 

0.06 

26 

14 

23 

13 

20 

5 

0.10 

24 

11 

25 

15 

20 

10 

0.37 

47 

29 

34 

18 

25 

5 

0.51 

39 

18 

39 

26 

25 

10 

1.87 

141 

80 

119 

50 

30 

5 

0.98 

47 

19 

53 

44 

30 

10 

1.23 

44 

21 

46 

24 

30 

15 

3.11 

47 

25 

43 

26 

35 

5 

5.10 

36 

14 

42 

31 

35 

10 

4.97 

49 

23 

50 

41 

35 

15 

13.49 

86 

49 

71 

54 

40 

5 

14.06 

47 

15 

61 

47 

40 

10 

31.87 

52 

22 

58 

45 

40 

15 

18.58 

47 

21 

51 

31 

40 

20 

21.78 

44 

21 

44 

28 

45 

10 

23.08 

20 

8 

22 

16 

45 

15 

147.66 

50 

20 

57 

48 

45 

20 

106.86 

124 

64 

117 

106 

of  89.6  seconds  for  the  remaining  eight  problems. 

Similar  observations  can  be  made  concerning  the  number 
of  times  it  was  necessary  to  execute  Steps  1  and  2 
within  the  same  problem  set.  The  greatest  variation 
occured  in  the  case  with  25  variables  where  10  variables 
are  controlled  by  the  follower.  For  one  problem,  the 
algorithm  performed  Step  1  219  times  and  Step  2  125 
times.  For  another  problem  of  this  size,  the  algorithm 
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performed  Step  1  seven  times  and  Step  2  three  times. 

The  averages  with  these  two  extremes  eliminated  is  Step 
1-32  and  Step  2-12.  For  problems  with  50  or  more 
variables  (results  not  shown  in  Table  4.1),  computation 
times  often  exceeded  900  seconds,  the  cutoff  time  chosen 
for  the  runs. 

After  solving  over  200  randomly  generated  problems, 
it  became  clear  the  performance  of  the  algorithm  is 
highly  problem  dependent.  The  cases  cited  above 
highlight  the  wide  variation  encountered  in  solving 
problems  of  the  same  size. 


£ 
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CHAPTER  5 


A  BRANCH  AND  BOUND  ALGORITHM  FOR  THE 

] 

BILEVEL  PROGRAMMING  PROBLEM  . 

i 

i 

5 . 1  Development  of  the  Kuhn-Tucker  Approach  ! 

In  this  chapter,  the  focus  is  on  the  linear  bilevel  , 

i 

programming  problem  (BLPP)  with  continuous  variables.  [ 

In  the  following  discussion  let  F(x,y)  represent  the 

objective  function  of  the  leader  and  let  f(x,y)  . 

< 

represent  the  objective  function  of  the  follower  where  x  < 

n4  1  ^ 

€  X  5  R  is  the  n  -dimensional  vector  of  decision  \ 

na 

variables  controlled  by  the  leader  and  y  e  Y  £  R  is  , 

2  * 

the  n  -dimensional  vector  of  decision  variables  j 

controlled  by  the  follower.  The  linear  BLPP  is  now  j 

j 

formulated  with  explicit  nonnegativity  constraints  on 


the  variables. 


(5.1a) 


1  2 

Max  F(x,y)  =  c  x  +  c  y  where  y  solves 
x 


Max  f(x,y) 

y 

=  d2y 

(5.1b) 

subject  to 

Ax  +  By  <  b 

(5.1c) 

x  >  0,  y  >  0 

(5. Id) 

12  2 

where  c  ,  c  ,  d  ,  A,  B,  and  b  are  as  defined  in  Section 

1.1. 

When  the  leader  has  selected  values  for  the 
decision  variables  he  controls,  the  follower's  problem 
becomes  a  standard  linear  programming  problem 
parameterized  in  x.  Because  the  follower's  problem  is  a 
linear  programming  problem  parameterized  in  x,  its 
solution  must  satisfy  the  Kuhn-Tucker  conditions  of  the 
follower's  problem.  The  follower's  problem  derived  from 
(5.1)  when  x  is  fixed  is 


Max  f(y)  =  d  y 

(5.2a) 

y 

subject  to  By  <  b  -  Ax 

(5.2b) 

y  >  0 

(5.2c) 

The  Kuhn-Tucker  conditions  of  (5.2)  are 


By  <  b  -  Ax 


2  1  2 
d  -  u  B  +  u  I  =  0 


u  ( b-Ax-By )  =  0 


u  y  =  0 

12  _  _ 

u  ,  u  ,  y  >0 


(5.3a) 


(5.3b) 


(5.3c) 


(5.3d) 


( 5 . 3e ) 


where  x  is  fixed,  u  is  an  m-dimensional  row  vector  of 

2  2 

Kuhn-Tucker  multipliers,  u  is  an  n  -dimensional  row 

vector  of  Kuhn-Tucker  multipliers  associated  with  the 

nonnegativity  constraints  on  the  variables  controlled  by 

2  2 

the  follower,  and  I  is  an  n  x  n  identity  matrix.  For 
ease  of  presentation,  the  set  of  functions  g(x,y)  is 

introduced.  For  i=l,...,m,  g^x.y)  =  b-Ax-By,  and  for 

2  12 
i=m+l ,  .  .  .  ,m+n  ,  aMx.y)  =  y.  Also,  define  u  s  (u  ,u  ) 

2 

where  u  is  an  m+n  -dimensional  row  vector  of  Kuhn-Tucker 
multipliers  associated  with  the  constraint  g(x,y)  >  o. 


Using  this  notation,  (5.1)  can  be  rewritten 


Max  F(x,y)  where  y  solves 


Max  f ( x , y ) 
Y 


subject  to  g(x,y)  >  0 


x  >  0 


5.4a) 


(5.4b) 


(5.4c) 
( 5 . 4d ) 
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In  the  above  formulation,  the  follower's  problem  can  be 
replaced  by  its  Kuhn-Tucker  conditions  (Bard  and  Falk 
1982,  Bialas  and  Karwan  1984,  Fortuny-Amat  and  McCarl 
1981).  The  result  is  the  following  equivalent 
representation  of  the  BLPP  (5.1). 


Max  F(x,y) 
x,y  ,u 


(5.5a) 


subject  to  g(x,y)  >  0 


(5.5b) 


*y[f(x,y)]  +  u*vy[g(x,y)]  =  0 


(5.5c) 


u*g(x,y)  =  o 


( 5 . 5d) 


u,  x  2:  0 


( 5 . 5e) 


where  v  represents  the  gradient  operator,  and  vy  is  the 

gradient  with  respect  to  y.  Bard  and  Falk  (1982)  solve 

problem  (5.5)  using  a  nonconvex  programming  algorithm 

based  on  a  branch  and  bound  approach.  Fortuny-Amat  and 

McCarl  (1981)  force  satisfaction  of  the  complementary 

slackness  conditions  by  transforming  (5.5)  into  a  larger 

mixed  integer  programming  problem.  Bialas  and  Karwan 

(1984)  use  a  Parametric  Complementary  Pivot  algorithm  to 

solve  (5.5).  Their  algorithm  is  limited  to  cases  where 
2 

c  ,  the  coefficients  in  the  leader's  objective  function 
of  the  variables  controlled  by  the  follower,  must  be 


•  --  rJ'  V'awV, 


nonnegative.  The  Parametric  Complementary  Pivot 
algorithm  produces  a  solution  which  is  within  y* 100$  of 
the  optimal  objective  function  value  where  y  is  a  small 
positive  scalar.  Also,  Bialas  and  Karwan's  (1984) 
algorithm  does  not  handle  the  degenerate  case.  Theorem 

3.2  states  the  solution  of  (5.1)  occurs  at  an  extreme 
point  of  the  constraint  region  defined  by  ( 5 . lc ) - ( 5 . Id) . 
Using  this  knowledge.  Bialas  and  Karwan  (1984)  develop 
an  algorithm  which  finds  the  optimal  solution  of  (5.1) 
by  testing  extreme  points  of  the  BLPP  constraint  region. 
Another  way  to  solve  this  problem  is  a  branch  and  bound 
procedure  which  forces  satisfaction  of  the  complementary 
slackness  conditions. 

5 . 2  The  Algorithm 

Using  a  branch  and  bound  approach  applied  to  (5.5), 
the  following  algorithm  finds  the  solution  of  (5.1). 

The  problem  defined  by  ( 5 . 5a-5 . 5c , 5 . 5e )  is  a  linear 
program  which  can  be  solved  using  standard  techniques. 
However,  a  solution  of  the  BLPP  must  also  satisfy 
(5.5d).  The  basic  idea  of  the  algorithm  is  to  suppress 
the  complementarity  term  (5.5d)  and  solve  the  resulting 
linear  subproblem.  At  each  iteration  of  the  algorithm, 
a  check  is  made  to  determine  if  the  complementary 
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slackness  conditions  are  satisfied.  If  so,  the 
corresponding  point  is  in  the  inducible  region,  and 
hence,  a  potential  solution  to  (5.1);  if  not,  a  branch 
and  bound  scheme  is  used  to  implicitly  examine  all 
combinations  of  complementary  slackness  conditions. 

Thus,  the  algorithm  solves  the  following  linear 
programming  problem  and  forces  satisfaction  of  the 
complementary  slackness  conditions  by  use  a  branch  and 
bound  procedure. 


Max  F(x,y) 
x,y,u 

subject  to  g(x,y)  >  0 


*y[f(x,y)]  +  u* vy[g(x,y) ]  =  0 


x,  u  >  0 


(5.6a) 


(5.6b) 


(5.6c) 


( 5 . 6d ) 


Before  presenting  the  algorithm,  the  notation  used 

in  the  branch  and  bound  process  is  defined.  Similar  to 

2 

Chapter  4,  let  W={ 1 , . . . , m , m+1 , . . . , m+n  )  be  the  index  set 
of  the  complementary  slackness  conditions  of  (5.5d),  and 
let  F_ be  the  incumbent  lower  bound  on  the  leader's 
objective  function.  Each  path  in  the  branch  and 
bound  tree  corresponds  to  an  assignment  of  either  u^  =  0 
or  gj  =  0  for  i  e  £  W.  Now  let 


WV*  W  UVUV\rtWVVfirJNG£»y'.  VS 
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i  t. 


Sk  =  {i  I  i  e  Wk  and  ui  =  0} 


S~  =  {i  |  i  6  Wk  and  gi  =  0> 


=  <i  |  i  *  Wk} . 


For  i€S,  ,  the  variables  u.  and  g.  are  free  to  assume 
k  1  a  1 


any  nonnegative  values  in  the  solution  of  (5.5)  with 


(5.5d)  suppressed,  so  (5.5d)  will  not  necessarily  be 


satisfied.  The  algorithm's  flow  chart  is  shown  in 


Figure  5 . 1 


Step  0:  (Initialization)  Put  k  =  0,  S+  =  <#>,  S.  =  <P ,  S° 


=  (1,  .  .  .  ,m+n  ),  and  F_  =  -co. 


Step  1:  (Iteration  k)  Set  u,  =  0  for  i€S,  and  g,  =  0 


for  i€Sk<  Attempt  to  solve  (5.6).  If  the 


resultant  problem  is  infeasible,  go  to  Step  5; 


otherwise  put  k«-k+l  and  label  the  solution 


,  k  k  k. 
(x  , y  ,u  ) . 


Step  2:  (Fathoming)  If  Ffx^.y^)  <  F_,  go  to  Step  5, 


ft 

ft' 

& 


£ 

ft 


¥ 

a 

j 


/!« 

$ 


k  k  k  2 

Step  3:  (Branching)  If  u^g^x  ,y  )  =  0,  i=l . m+n  , 

go  to  Step  4;  otherwise,  select  i  for  which 

u^*g^(x^,y^)  is  largest  and  label  it  i^.  Put 

<  -  sk u  (ii»’  sk  ^  sk x  (1i>'  * v  add  a 

live  vertex  to  the  branch  and  bound  tree,  and 

go  to  Step  1 . 

Step  4:  (Updating)  F_ =  F(xk,yk). 

Step  5:  (Backtracking)  If  no  live  vertex  exists,  go  to 
Step  6.  Otherwise  branch  to  the  newest  live 
vertex  and  update  S+,  S^,  and  S®.  Go  to  Step 
1 . 

Step  6:  (Termination)  If  F_  =  -co ,  there  is  no  feasible 
solution  to  (5.1).  Otherwise,  declare  the 
feasible  point  associated  with  F_ the  optimal 
solution . 

Step  1  is  designed  to  find  a  new  point  which  is 
potentially  bilevel  feasible.  If  no  solution  exists,  or 
the  solution  does  not  offer  an  improvement  over  the 
incumbent  (Step  2),  the  algorithm  goes  to  Step  5  and 
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backtracks.  At  Step  3,  a  check  is  made  to  determine  if 
the  complementary  slackness  conditions  are  satisfied. 
Confirmation  indicates  that  a  feasible  solution  of  the 
bilevel  program  has  been  found,  and  at  Step  4,  the  lower 
bound  on  the  leader's  objective  function  is  updated. 
Alternatively,  if  the  complementary  slackness  conditions 
are  not  satisfied,  the  term  with  the  largest  product  is 
used  at  Step  3  to  provide  the  branching  variable. 
Branching  is  always  done  on  the  Kuhn-Tucker  multiplier, 
and  vertices  are  added  to  the  tree  in  a  depth  wise 
manner . 

At  Step  5,  the  backtracking  operation  is  performed. 
Once  again,  to  facilitate  bookkeeping,  the  path  in 
the  branch  and  bound  tree  is  represented  by  an  £- 
dimensional  vector  where  £  is  the  current  depth  of  the 
tree.  The  order  of  the  components  of  is  determined 
by  their  "level"  in  the  tree.  Indices  only  appear  in  Pk 
if  they  are  in  either  S*  or  S^  with  the  entry  underlined 
if  they  are  in  S^.  Because  the  algorithm  always 
branches  on  a  Kuhn-Tucker  multiplier  first,  backtracking 
is  accomplished  by  finding  the  rightmost  nonunderlined 
element  of  P^,  underlining  it,  and  erasing  a  1 1  entries 


6  a 


».* My, 
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to  the  right.  The  newly  underlined  entry  is  deleted 
from  S+  and  added  to  S^;  the  erased  entries  are  deleted 
from  and  added  to  S^.  This  leads  to  the  following 

result . 

Proposition  5.1:  Under  the  uniqueness  assumption 
associated  with  the  rational  reaction  set,  ¥(x) ,  the 
algorithm  terminates  with  the  optimal  solution  of  the 
BLPP  (5.1). 

Proof :  The  algorithm  forces  satisfaction  of  the 

complementary  slackness  conditions  of  (5.5)  which  is  an 
equivalent  representation  of  (5.1).  By  implicitly 
considering  all  combinations  of  u*g(x,y)  at  Steps  3  and 
5,  the  optimal  solution  cannot  be  overlooked.  ■ 

5 . 3  Other  Forms  of  the  BLPP 

The  BLPPs  which  the  algorithm  solves  are  not 
limited  to  those  which  take  the  form  of  (5.1).  Because 
the  follower's  problem  is  converted  into  an  equivalent 
form  using  the  Kuhn-Tucker  conditions,  the  linearity  of 
the  equivalent  problem  (5.5)  is  maintained  when  the 
follower's  objective  function,  f(x,y),  is  quadratic: 


2  1  T 

f(x,y)  =  d  y  +  ^ x » Y )  g(x,y)  where  g  is  a  symmetric 

2  2 

matrix  whose  lower  n  x  n  submatrix  is  negative 
semidefinite  and  T  is  the  transpose  operator.  Equality 
constraints  may  also  be  included  in  the  BLPP.  The  Kuhn- 
Tucker  multipliers  associated  with  these  constraints  are 
unrestricted  in  value,  so  they  would  not  be  included  in 
the  complementary  slackness  conditions.  The  algorithm 
can  also  solve  the  BLPP  where  some  or  all  of  the 
decision  variables  have  upper  (and  lower)  bounds.  Thus, 
the  BLPP  which  the  algorithm  solves  has  the  following 


form 


1  2 

Max  F(x,y)  =cx+cy  where  y  solves 
x 

Max  f(x,y)  =  d2y  +  |(x,y)Tg  (x,y) 

Y 

subject  to  Ax  +  By  <  b1 

Cx  +  Dy  =  b2 


0  <  x  <  U 


0  <  y  <  U 


(5.7a] 


(5.7b) 


(5.7c) 
( 5 . 7d ) 
( 5 . 7e ) 
( 5 . 7f ) 


12  2 

where  c  ,  c  ,  and  d  are  as  defined  in  Section  1.1,  A  is 

11  12 
an  m  *  n  dimensional  matrix,  B  is  an  m  *  n 

2  1 

dimensional  matrix,  C  is  an  m  x  n  dimensional  matrix, 

2  2  11 
D  is  an  m  x  n  dimensional  matrix,  b  is  an  m  - 

2  2 

dimensional  column  vector,  b  is  an  m  -dimensional 
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11  2 
column  vector,  U  is  an  n  -dimensional  column  vector,  U 


is  an  n  -dimensional  column  vector,  T  is  the  transpose 


12  12 

operator,  and  g  is  a  symmetric  (n  +n  )  *  (n  +n  ) -matrix 


2  2 

whose  lower  n  x  n  submatrix  is  negative  semidef inite . 


1  2 

In  coding  the  algorithm,  a  lower  triangular  (n  +n  ) 


1  2 

(n  +n  ) -matrix,  L,  is  used  to  ease  data  input 


requirements.  The  matrix  L  is  used  in  the  following 


discussion  to  aid  presentation  of  the  Kuhn-Tucker 


representation  of  (5.7).  Since  L  is  a  lower  triangular 


matrix,  the  quadratic  portion  of  (5.7b)  can  be 


represented  by  the  entry  of  the  coefficients  of  the 


nonlinear  terms  with  one  entry  per  term.  Before  using 


the  Kuhn-Tucker  approach  to  write  the  equivalent 


representation  of  (5.7),  a  more  detailed  picture  of  the 


L  matrix  is  given.  The  L  matrix  may  be  partitioned  as 


follows 


where  is  an  n1  x  n1  lower  triangular  matrix,  L2  is  an 


2  1  2  2 
n  *  n  matrix,  and  is  an  n  *  n  lower  triangular 


2 

matrix.  Also,  define  the  diagonal  of  L3  a9  the  n  - 
dimensional  vector  £ .  Derive  a  symmetric  matrix  with 
zeros  down  the  diagonal  from  L3 .  Derive  this  matrix  by 

3 

setting  the  entries  on  the  diagonal  of  L  to  zero.  Then 
add  this  matrix  to  its  transpose.  The  resulting 
symmetric  matrix  is  designated  L®.  This  manipulation  of 
L  eases  formulation  of  the  Kuhn-Tucker  representation  of 
(5.7)  . 

The  Kuhn-Tucker  equivalent  of  (5.7)  is 

Max  F(x,y)  =  c*x  +  c2y  (5.8a) 

12  3  4 

x,y,u  , u  , u  , u 


subject  to  Ax 

+  By  <  b1 

(5.8b) 

Cx 

+  Dy  =  b2 

(5.8c) 

0 

<  x  <  U1 

(5.8d) 

0 

<  y  <  U2 

(  5 . 8e ) 

d2  +  L2x  +  L®y  +  2£y  - 

u1B  +  u2D  +  u3  -  u4  =  0 

(5.8f ) 

u^b1  -  Ax  - 

By)  =  0 

( 5 . 8g ) 

u3y  =  0 

(  5 . 8h ) 

4.„2 
u  ( U 

-  y)  =  0 

(5.81) 

1  3 

4 

(  5 . 8  j  ) 

u  ,  u 

,  u  >  0 

2 

u  unrestricted 


(5.8k) 


k*  M  1.4  ■  < 


12  3  4 

where  u  ,  u  ,  u  ,  and  u  are  vectors  of  Kuhn-Tucker 

12  2  2 

multipliers  with  dimension  m  ,  m  ,  n  ,  and  n  , 
respectively,  and  are  associated  with  constraint  (5.8b), 
constraint  (5.8c),  the  nonnegative  restriction  on  y,  and 
the  upper  bound  constraints  on  y,  respectively . 

Equation  (5.8f)  represents  the  linear  set  of  constraints 
derived  when  the  gradient  is  taken  with  respect  to  y. 

5 . 4  Examples 

Three  examples  are  presented  to  illustrate  the 
algorithm.  The  first  is  taken  from  Bard  (1984).  This 
example  is  the  same  one  used  to  illustrate  the  0-1  BLPP 
algorithm  in  Chapter  4.  The  second  is  taken  from 
Candler  and  Townsley  (1982)  and  serves  to  contrast  the 
performance  of  the  various  iterative  schemes.  The  third 
example  contains  nonlinear  terms  in  the  follower's 
objective  function  and  also  has  an  equality  constraint 
and  an  upper  bounded  variable. 


Example  5 . 1 

Max  F(x,y)  =  -x  -y  where  y  solves 
x 

Max  f(x,y)  =  5x  +  y 
Y 

subject  to 

x  +  y/2  >  2 


-x/4  +  y  <2 
x  +  y/2  <  8 
x  -  2y  <4 
x  >  0 ,  y  >  0 

The  graph  of  Example  5.1  is  shown  in  Figure  5.2,  and  its 
equivalent  representation  using  the  Kuhn-Tucker  approach 


Max  F(x,y)  =  -x  -y 
x,y,u 


subject  to 


x  +  y/2  >  2 

-x/4  +  y  <2 
x  +  y/2  <  8 
x  -  2y  <4 


0.5u1  -  u2  -  0.5u3  +  2u4  +  u&  = 


u  (x  +  y/2  -  2 )  =  0 


u2(2  +  x/4  -  y)  =  0 


u3(8  -  x  -  y/2)  =  0 


u4(4  -  x  +  2y)  =  0 


u5(y)  =  0 


x,  y,  u  >  0 


'  “  v;a’.vaxva'.va 


where  u.^ ,  i=l,...,5,  are  the  Kuhn-Tucker  multipliers 
associated  with  the  constraints  containing  variables 
controlled  by  the  follower,  and,  for  conciseness,  let 
g^,  1=1,..., 5,  be  the  corresponding  functions. 

The  algorithm  solves  the  above  problem  by 
explicitly  setting  either  or  g.^ ,  i=l,...,5,  to  zero 
in  a  branch  and  bound  process.  At  Step  1,  the  algorithm 
solves  the  linear  program  which  results  when  the 
complementary  slackness  conditions  are  removed.  The 
solution  passes  the  test  at  Step  2.  At  Step  3,  the  pair 
(u2,g2)  has  the  largest  product  so  S*  =  {2},  s”  =  $ ,  and 
S^  =  {1,3, 4,5).  Going  to  Step  1,  the  new  problem  is 
solved.  At  Step  3  the  branching  variable  is  ug ,  so  S*  = 
{2,3},  S2  =  0,  and  S°  =  {1,4,5}.  At  Step  1,  the  new 
problem  is  infeasible,  so  the  algorithm  proceeds  to  Step 
5.  At  Step  5,  backtracking  is  accomplished  and  S+  = 

{2},  S2  =  {3},  and  S2  =  {1,4,5}.  Returning  to  Step  1,  a 
solution  is  obtained,  the  test  at  Step  2  is  passed,  and 
at  Step  3,  the  complementary  slackness  conditions  are 
satisfied,  so  a  solution  in  the  inducible  region  of  the 
BLPP  has  been  found.  The  algorithm  goes  to  Step  4  where 
the  incumbent  is  updated  (F=-8.8).  At  Step  5,  the 


algorithm  again  backtracks,  and  S*  =  <P ,  S 3  =  {2},  and  S 
=  {1,3,4, 5}.  Continuing  at  Step  1,  a  solution  is  found, 
and  the  test  at  Step  2  is  passed.  At  Step  3,  the 
branching  variable  is  ug  so  S*  =  {3},  S~  =  {2},  and  S°  = 
{1,4,5}.  At  Step  1,  a  new  solution  is  found  which 
passes  the  test  at  Step  2  and  satisfies  the 
complementary  slackness  conditions  at  Step  3.  At  Step 
4,  the  incumbent  is  updated,  so  F_  =  -28/9,  and  the 
algorithm  backtracks  at  Step  5  where  S+  =  <p , 

S^  =  {2,3},  and  S®  =  {1,4,5}.  At  Step  1,  a  new  solution 
is  found,  but  the  solution  does  not  pass  the  test  at 
Step  2.  The  algorithm  goes  to  Step  5  and  does  not  find 
a  live  vertex,  so  the  algorithm  proceeds  to  Step  6  and 
terminates  with  the  solution  (x*,y*)  =  (8/9,20/9)  and  F 
=  -28/9.  The  branch  and  bound  tree  created  by  the 
algorithm  has  six  vertices  and  is  shown  in  Figure  5.3. 
Note  each  vertex  in  the  branch  and  bound  tree 
corresponds  to  the  solution  of  a  linear  subproblem. 
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The  example  presented  by  Candler  and  Towns  ley 
(1982)  to  test  their  iterative  scheme  was  also  used  by 
Bard  and  Falk  (1982)  to  demonstrate  the  workings  of 
their  approach.  Candler  and  Townsley's  example  has  two 
variables  controlled  by  the  leader,  three  variables 
controlled  by  the  follower,  and  three  constraints.  The 
example  follows. 


Example  5 . 2 


Max  F(x,y)  =  8Xj  +  4xg  -  4y1  +  40y2  +  4y3  where  y  solves 

JC 


Max  f (x,y)  =  -*1  -  2x2  -  y±  -  y2  -  2y3 


subject  to 


Y1  -  *2  -  *3  "  _1 


-2xx  +  yx  -  2y2  +  0.5y3  >  -1 


■2x2  -  2y1  +  y2  +  0.5y3  >  -l 


x  >  0 


y  >  0 
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When  this  example  is  rewritten  in  its  equivalent  form 
(5.5),  six  Kuhn-Tucker  multipliers  are  added  to  the 
problem.  The  equivalent  Kuhn-Tucker  representation  is 

Max  F(x,y)  =  8x  +  4xg  -  4yx  +  40y2  +  4y3 
x ,  y ,  u 

subject  to 

?1  -  y2  -  y3  -  -1 

-2x1  +  Yi  -  2y2  +  0.5y3  >  -1 

-2x2  -  2y1  +  y2  +  0.5y3  >  -1 


U1 

+  u2 

2U3  +  u4 

=  1 

—  lu, 

2u_ 

+ 

u_ 

+  u_  =  1 

1 

2 

3 

5 

-U1 

CM 

P 

m 

o 

+ 

+ 

°.5u3 

+  u6  -  2 

U1(Y1  ~  y2  ~  y3  +  1]  =  0 


U2<'2X1 

1 

H 

> 

+ 

-  2y2 

+  0.5y3  + 

1)  =  0 

U3<'2x2 

~  2yl 

+  y2 

+  o.5y3  + 

1)  =  0 

VY1>  =  ° 

u5(y2)  -  0 
u6(y3)  =  0 


x  >  0 ,  y  >  0 ,  u  >  0 
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The  algorithm  could  solve  as  many  as  64  subproblems 

before  terminating.  In  fact,  the  optimal  solution  was 

uncovered  on  the  fourth  iteration  but  was  not  confirmed 

until  10  subproblems  were  examined.  After  initializing 

all  required  data,  the  algorithm  finds  a  feasible 

solution  to  the  above  Kuhn-Tucker  representation  with 

the  complementary  slackness  conditions  omitted,  and 

proceeds  to  Step  3.  The  current  point,  x1  =  (0,0),  y1  = 

(1.5, 1.5,1),  u1  =  (0,0, 0,1, 1,2)  does  not  satisfy 

complementarity  so  a  branching  variable  is  selected  (u_) 

o 

and  the  index  sets  are  updated,  giving  S*  =  (6),  S~  =  <p , 
and  S^  =  {1,2, 3, 4, 5).  Returning  to  Step  1,  a  feasible 
solution  is  found,  but  the  complementary  slackness 
conditions  are  not  satisfied  at  Step  3,  so  u&  is  picked 
as  the  branching  variable  with  S*  =  {5,6},  S~  =  <t> ,  and 
S°  =  (1,2, 3, 4).  Continuing  at  Step  1,  a  feasible 
solution  is  found  which  passes  the  test  at  Step  2.  At 
Step  3,  u^  is  choosen  as  the  branching  variable,  so  S+  = 
{4,5,6},  S3  =  <t> ,  and  =  {1,2,3}.  Proceeding  to  Step 
1,  the  subproblem  is  infeasible,  so  the  algorithm  goes 
to  Step  5  and  backtracks.  At  Step  5,  S*  =  (5,6),  S~  = 
{4},  and  S^  =  {1,2,3}.  Going  to  Step  1,  a  feasible 


solution  is  found  which  passes  the  test  at  Step  2  and 
satisfies  the  complementary  slackness  conditions  at  Step 
3.  Continuing  at  Step  4,  F_  =  29.2.  Backtracking  at 
Step  5,  S+  =  { 6 }  ,  S'  =  {4,5},  and  S°  =  {1,2,3}. 
Continuing  at  Step  1,  a  feasible  solution  is  found,  but 
at  Step  2,  the  value  of  the  leader's  objective  function 
for  the  current  point  is  less  than  the  incumbent  lower 
bound,  so  the  algorithm  goes  to  Step  5  and  backtracks, 
giving  S*  =  <fi ,  S~  =  {6},  and  S°  =  {1,2, 3, 4, 5}.  Going  to 
Step  1,  the  algorithm  obtains  a  feasible  solution  which 
passes  the  test  at  Step  2.  At  Step  3,  u4  is  selected  as 
the  branching  variable,  and  S*  =  {4},  S6  =  {6},  and  sj?  = 
{1,2, 3, 5}.  Proceeding  to  Step  1,  a  feasible  solution  to 
the  current  subproblem  is  found,  Step  2  does  not  fathom 
the  solution,  and  at  Step  3,  u  is  the  branching 
variable.  S*  =  {4,5},  S?  =  {6},  and  S°  =  {1,2,3},  and 
going  to  Step  1,  the  new  subproblem  is  infeasible.  The 
algorithm  goes  to  Step  5  and  backtracks  with  S+  =  {4}, 

S^  =  {5,6},  and  S^  =  {1,2,3}.  Returning  to  Step  1,  a 
new  solution  is  found  which  fails  the  test  at  Step  2,  so 
backtracking  is  done  at  Step  5.  S*  =  <f> ,  S?  =  {4,6},  and 
S°  =  {1,2, 3, 5},  and  at  Step  1,  the  solution  found  fails 


to  be  better  than  the  current  incumbent  lower  bound,  so 
the  algorithm  proceeds  to  Step  5.  No  live  vertex 
exists,  so  the  the  algorithm  goes  to  Step  6  and 
terminates.  The  optimal  solution  is  found  in  the  fourth 
subproblem,  and  six  additional  subprobleras  are  solved  to 
guarantee  no  better  solution  exists.  The  optimal 
solution  is  x  =  (0,0.9),  y  =  (0,0. 6, 0.4),  u*  = 

(0,1, 3, 6, 0,0)  with  F  =  29.2.  The  branch  and  bound  tree 
for  this  example  is  shown  in  Figure  5.4. 

By  way  of  comparison,  when  this  problem  was  solved 

with  the  separable  programming  approach  of  Bard  and  Falk 

(1982),  the  optimal  solution  was  uncovered  on  the  51st 

Iteration  but  not  recognized  until  iteration  103.  (Each 

iteration  required  the  solution  of  a  linear  program  in 
1  2 

n  +  n  +  2m  variables  and  2m  constraints.)  This  result 
typifies  the  relative  performance  of  these  two 
algorithms . 


The  third  example  demonstrates  the  algorithm's 
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ability  to  solve  problems  with  quadratic  terms  in  the 
follower's  objective  function,  an  upper  bounded 
variable,  and  an  equality  constraint.  The  example  is 
shown  below. 


Example  5 . 3 


CM 

* 

CM 

+ 

-  4Yl 

+  5y2  +  10y3 

where  y  solves 

=  yi 

-  y2  - 

-  7y3  +  87x2  + 

6x 

1Y1  +  X1Y3 

+ 

8X2Y2 

+  7x2y3  "  ylY 

3  + 

5y2  +  9y2y3 

xi  + 

X2 

<  50 

2x1  + 

4X2  " 

yi 

=  20 

3X1 
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4yx  + 

y3 

>  10 

X2 

-  4y2  + 

2y3 

<  25 

0  < 

y2  ^  ioo 

V  V  Yl'  y3  -  0 


Prior  to  writing  the  problem  in  the  form  of  (5.8),  the  L 
matrix  as  it  would  appear  in  the  follower's  objective 
function  is  presented. 
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a 
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Max  F(x,y)  =  x1  +  2xg  -  4yl  +  5y2  +  10y3 


subject  to 


X1 + 

X2 

< 

50 

2x^  + 

4x2  '  yl 

= 

20 

3xi 

+  4yt 

+ 

Y3 

> 

10 

X2  -  4y2 

+ 

2Y3 

< 

25 

ui 

+  4u.  +  u.  +  6x 
2  4 

1 

Y3 

= 

-1 

4u3  +  u5  - 

u?  +  8x2  +  10y2 

+ 

9Y3 

= 

1 

U2  -  2U3  *  U6 

+  Xx  +  ?x2  -  yx 

+ 

9y2 

= 

7 

u 

2(3x:  +  4y,  +  y3 

- 

10) 

= 

0 

u 

J25  -  X  2+  4y  2- 

2y  i  ■ 

=  0 

i 

U4Y1  +  U5Y2 

+  U6y3  +  U7(10° 

- 
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0 

y2 

< 

100 

0,  y  >  0,  Uj^  unrestricted,  ui  > 

o. 

i  = 

2,  . 
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where  u^,  1=1,..., 7,  are  the  Kuhn-Tucker  multipliers. 

The  first  point  uncovered  by  the  algorithm  at  Step 
1  is  x1  =  (10,0)  and  y1  =  (0,100,212.5)  which  is  not 
recognized  as  bilevel  feasible.  The  fathoming  test  is 
passed  at  Step  2,  and  at  Step  3,  the  algorithm  branches 


vow?. 


{1,3, 4, 5, 6,7} . 


oh  u2  with  S+  =  {2},  s“  =  0,  and  S°  = 

Returning  to  Step  1,  a  new  solution  is  found  which 
passes  the  test  at  Step  2.  At  Step  3,  the  complementary 
slackness  conditions  are  satisfied,  so  the  algorithm 
proceeds  to  Step  4  and  updates  the  lower  bound  by 
setting  F_ =  2,635.  At  Step  5,  the  algorithm  backtracks 
with  S+  =  0,  S~  =  {2},  and  S°  =  {1,3, 4, 5, 6, 7}. 

Continuing  at  Step  1,  a  new  solution  is  found  whose 
value  is  less  than  the  current  value  of  F_,  so  the 
corresponding  vertex  is  fathomed  at  Step  2,  and  the 
algorithm  proceeds  to  Step  5  to  begin  backtracking. 
However,  there  are  no  live  vertices  in  the  tree,  so  the 
algorithm  goes  to  Step  6  and  terminates.  The  optimal 
solution  is  x*  =  (10,0),  y*  =  (0,100,212.5),  u*  = 
(0,0,451.5,151.5,0,0,4717.5)  with  F  =  2,635. 

5 . 5  Computational  Experience 

In  order  to  test  the  efficiency  of  the  algorithm,  a 
series  of  problems  were  randomly  generated  and  solved. 

In  all  cases,  the  coefficients  of  the  A  and  B  matrices 
ranged  between  -15  and  45  with  approximately  25  percent 
of  the  coefficients  being  less  than  zero.  The 
coefficients  of  the  two  objective  functions  varied 
between  -20  and  20  with  approximately  50  percent  being 


less  than  zero.  The  number  of  constraints  in  each 
problem  was  set  at  0.4  times  the  total  number  of 
variables,  and  the  right-hand  side  values  ranged  between 
0  and  50.  The  signs  of  the  constraints  had  a  0.7 
probability  of  being  <  and  a  0.3  probability  of  being  >. 
The  density  of  both  the  A  and  the  B  matrices  was 
approximately  0.4. 

All  computations  were  performed  on  an  IBM  308 1-D 
using  the  VS  Fortran  compiler.  The  linear  programming 
subroutine  library  XMP  (Marsten  1981}  was  used  to  solve 
the  linear  subproblems  encountered  at  Step  1.  The 
primal  simplex  was  used  to  solve  each  subproblem,  and 
variables  required  to  be  zero  were  set  by  making  their 
upper  and  lower  bounds  zero. 

In  converting  a  problem  into  a  form  which  can  be 
manipulated  by  the  algorithm,  slack  variables  are  added 
to  the  constraints,  g^ ,  i=l,...,m.  These  slacks  are 
included  as  input  and  are  used  to  convert  each 
constraint  into  an  equality.  That  is,  gi  <  0, 
i=l,...,m,  is  converted  into  an  equality  by  the  addition 
of  the  slack  variables,  s^  i=l,...,m.  The  constraints 
assume  the  form  gA  +  s^  =  0.  In  the  algorithm,  the 


constraint  gi  is  set  to  zero  by  setting  the  associated 
slack  variable  s^  to  zero. 

5.5.1  Alternatives  Explored  During  Testing 

In  the  actual  implementation,  whenever  a  feasible 
solution  is  found  at  Step  1 ,  the  accompanying  basis  is 
stored  in  XMP  format  and  used  as  the  starting  point  for 
for  the  next  subproblem.  Two  other  procedures  for 
maintaining  a  starting  basis  were  tested.  In  the  first 
instance,  the  previous  basis,  whether  feasible  or  not, 
was  used  to  initiate  the  next  subproblem.  Results 
indicate  this  approach  is  slightly  worse  than  the  one 
finally  decided  upon.  In  test  problems,  the  number  of 
subproblems  solved  at  Step  1  ranged  between  22  more  and 
22  less  than  the  implemented  approach.  The  average 
difference  in  CPU  time  was  negligible.  However,  the 
implemented  approach  did  appear  to  perform  slightly 
better  on  large  problems.  The  second  approach  used  the 
basis  from  the  last  solution  in  the  inducible  region  of 
the  BLPP.  It  produced  CPU  times  two  to  three  times 
larger  than  the  other  approaches  and  was  discarded. 

An  important  determinant  of  computational 


efficiency  is  the  rule  for  selecting  the  branching 
variable  at  Step  3.  The  rule  chosen  branches  on  the 
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Kuhn-Tucker  multiplier  associated  with  the  largest 

complementarity  term,  u^g^,.  Other  rules  were  examined 

including  one  that  worked  well  for  nonlinear  problems. 

Here,  the  selection  is  made  by  finding  the  surface  on 

which  F  increases  most  rapidly;  i.e.,  by  solving: 

max1[vF(xk,yk:)  •  vgA  (xk,yk)  /||vF(xk,yk)  II  •  ||vgi  (xk,yk)  ||  ] 

where  v  is  the  gradient  operator  and  ||  ||  is  the 

Euclidean  norm.  Note  that  when  the  problem  is  linear, 

the  order  of  the  components  is  automatically 

established.  Using  the  rule  and  branching  on  g,  or 

setting  g  equal  to  zero,  resulted  in  large  increases  in 

CPU  time  and  the  number  of  subproblems  solved;  branching 

on  u  led  to  some  improvement  but  anywhere  from  50  to  100 

additional  subproblems  had  to  be  solved.  These  results 

were  observed  for  moderate  size  problems  where  n1  =  15, 

2 

n  =10,  and  m  =  10. 

After  testing  several  other  rules,  it  became 
evident  that  branching  on  g  is  not  efficient.  The 
branch  and  bound  trees  increase  in  size  rapidly,  so  many 
additional  subproblems  are  solved.  In  contrast,  by 
forcing  Kuhn-Tucker  (KT)  multipliers  to  zero,  one  of  two 
situations  quickly  arises:  either  one  of  the 
stationarity  conditions  (5.5c)  becomes  infeasible  or  a 
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point  in  the  inducible  region  emerges.  For  this  reason, 
the  experimentation  is  limited  to  the  following 
branching  rules 

1)  KT  multiplier  with  largest  value. 

2)  KT  multiplier  with  smallest  value. 

3)  KT  multiplier  associated  with  largest  g. 

4)  KT  multiplier  associated  with  smallest  g. 

5)  KT  multiplier  associated  with  smallest  u*g 
product . 

For  moderate  size  problems,  it  was  found  that  none 
of  these  rules  performed  as  well  as  the  current 
procedure.  Increases  in  CPU  time  of  10  to  30  seconds  or 
30  to  200  percent  were  observed.  Also,  the  number  of 
subproblems  solved  showed  increases  up  to  400. 

5.5.2  Results 

Table  5.1  shows  the  size  of  each  problem  class  as 
defined  by  the  total  number  of  variables,  number  of 
variables  controlled  by  the  leader,  number  of  variables 
controlled  by  the  follower,  and  the  number  of 
constraints.  For  each  problem  class,  10  problems  were 
randomly  generated. 


TABLE  5.1: 


PROBLEM  SIZES 


Problem 

Class 

No .  of 
Variables 
(n‘  +na  ) 

Leader 
Variables 
(n‘  ) 

Follower 
Variables 
(n*  ) 

No .  of 
Constraints 

1 

40 

28 

12 

16 

2 

40 

24 

16 

16 

3 

50 

35 

15 

20 

4 

50 

30 

20 

20 

5 

50 

25 

25 

20 

6 

50 

20 

30 

20 

7 

70 

42 

28 

28 

8 

70 

35 

35 

28 

9 

90 

54 

36 

36 

10 

90 

45 

45 

36 

11 

100 

60 

40 

40 

Table  5.2  summarizes  the  computational  experience 
with  the  algorithm.  Each  entry  represents  the  average 
of  10  randomly  generated  problems.  In  all,  110  problems 
ranging  in  size  from  40  to  100  variables  and  16  to  40 
constraints  were  solved.  Performance  measures  include 
CPU  time  (seconds),  the  number  of  vertices  in  the  branch 
and  bound  tree,  and  the  vertex  at  which  the  optimal 
solution  is  found.  Since  a  subproblem  is  solved  at  each 
vertex,  the  number  of  vertices  also  represents  the 
number  of  subproblems  solved  at  Step  1  of  the  algorithm. 


TABLE  5.2:  COMPUTATIONAL  RESULTS 


Problem 

Class 

CPU  Time 
(sec) 

Average 
No .  of 
Vertices 

No.  of 
Vertices 
( Range ) 

Optimal 

Solution 

(Vertex) 

1 

4.44 

18 

6-42 

11 

2 

8.50 

40 

8-202 

27 

3 

17.24 

39 

10-112 

26 

4 

16.46 

35 

18-124 

23 

5 

32.39 

73 

16-218 

46 

6 

179.01 

447 

30-1250 

391 

7 

106.99 

96 

32-270 

67 

8 

122.26 

106 

26-246 

84 

9 

352.37 

138 

30-384 

81 

10 

469 . 40 

191 

132-374 

147 

11 

294.22 

159 

34-476 

120 

As  expected,  the  CPU  time  grows  exponentially  with 

the  size  of  the  problem,  but  more  importantly,  depends 

on  the  way  the  variables  are  partitioned  between  the 

players.  As  the  number  of  variables  controlled  by  the 

follower  increases,  the  number  of  variables  included  in 

the  branch  and  bound  process  increases  along  with  the 

expected  computational  burden.  Compare,  for  example, 

the  two  cases  with  90  variables  and  36  constraints.  If 
2 

n  =36,  there  are  72  Kuhn-Tucker  multipliers  (4.72  • 

21  2 
10  possible  subproblems)  while  if  n  =45  there  are  81 

24 

Kuhn-Tucker  multipliers  (2.41  •  10  possible 
subproblems).  Thi3  difference  is  reflected  in  the  CPU 


2 

time  as  the  case  with  n  =45  requires,  on  average,  81 
additional  CPU  seconds. 

Also,  as  seen  in  Table  5.2,  large  differences  in 
computational  effort  often  result  among  problems  of 
equivalent  size.  In  problem  class  11,  34  subproblems 
had  to  be  solved  at  one  extreme  and  476  at  the  other. 

The  corresponding  CPU  times  were  85  and  804  seconds, 
respectively. 

It  Is  interesting  to  compare  the  above  findings 
with  those  reported  by  others.  Although  Fortuny-Amat 
and  McCarl  (1981)  did  not  seriously  test  their  approach, 
some  experience  with  their  approach  showed  that  as  the 
size  of  the  BLPP  increased,  the  size  of  the  reformulated 
problem  increased  rapidly.  By  testing  a  few  moderate 
sized  problems,  it  quickly  became  apparent  that  the 
procedure  is  only  as  good  as  the  underlying  mixed 
integer  code.  In  addition,  constraint  redundancies  in 
the  form  of  g^  =  0  and  g^  >  0  seem  to  place  an 
unnecessary  burden  on  the  computations.  Bialas  and 
Karwan  (1984)  report  results  for  both  their  "Kth-Best" 
algorithm  and  their  Parametric  Complementary  Pivot  (PCP) 
approach.  (The  former  did  not  fair  too  well  so  it  will 
not  be  discussed.)  Table  5.3  presents  a  comparison  of 
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the  PCP  algorithm  and  the  branch  and  bound  algorithm 
presented  above.  For  each  case,  Bialas  and  Karwan 
solved  five  problems.  Their  computations  were  done  on  a 
CDC  Cyber  174  using  a  Fortran  IV  code. 


TABLE  5.3:  COMPARISON  OF  COMPUTATIONAL  RESULTS 


No.  of 
Variables 
(n‘  +n*  ) 

Follower 
Variables 
(n*  ) 

No.  of 
Consts . 

PCP 

CPU  Time 
(sec) ♦ 

B&B 

CPU  Time 
( sec ) ♦ 

40 

12 

16 

4.46 

4.44 

40 

16 

16 

11.23 

8.48 

50 

15 

20 

16.48 

17.24 

50 

20 

20 

16.52 

16.46 

♦Average  of  5  problems;  CDC  Cyber  174 
♦Average  of  10  problems;  IBM  3081-D 


As  can  be  seen,  the  results  are  similar  but  tend  to 

favor  the  branch  and  bound  algorithm  when  the  relative 

speed  of  the  machines  is  taken  into  account.  To  truly 

determine  which  approach  is  better,  a  wide  variety  of 

problems  should  be  solved  using  the  two  algorithms.  It 

should  be  mentioned,  however,  that  the  PCP  approach  is 

not  completely  general.  Its  main  liability  centers  on 

the  requirement  that  the  leader's  objective  function 

2 

coefficients  be  nonnegative;  i.e.,  c  >  0.  Moreover, 


convergence  is  not  guaranteed  in  the  presence  of 


degeneracy,  and  in  most  instances,  the  algorithm  only 
produces  £ -optimal  solutions. 
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CHAPTER  6 

AN  ALGORITHM  FOR  THE  MIXED  INTEGER  BILEVEL 
PROGRAMMING  PROBLEM 


6 . 1  The  Mixed  Integer  BLPP 

The  linear  mixed  integer  bilevel  programming 
problem  (BLPP)  is  an  interesting  and  challenging 
problem,  and  currently,  no  other  algorithms  exist  which 
solve  this  problem.  In  the  mixed  integer  BLPP,  the 
variables  are  divided  into  four  categories.  Let  x1  be 

the  n11 -dimensional  vector  of  continuous  variables 

1  1  n‘  1  2 

controlled  by  the  leader  where  x  e  X  £  r  ,  let  x  be 

12 

the  n  -dimensional  vector  of  integer  variables 

2  2  nl  *  1 

controlled  by  the  leader  where  x  €  X  £  R  ,  let  y  be 

21 

the  n  -dimensional  vector  of  continuous  variables 

1  1  n*  ‘ 

controlled  by  the  follower  where  y  e  Y  £  R  ,  and  let 
2  22 

y  be  the  n  -dimensional  vector  of  integer  variables 

2  2  *  * 

controlled  by  the  follower  where  y  €  Y  £  R  .  In  the 
1  1112  2  2122 

above,  n  =  n  +n  ,  n  =  n  +n  ,  and  R  is  the  set  of 
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real  numbers.  Let  F(x,y)  represent  the  objective 
function  of  the  leader,  and  let  f(x,y)  represent  the 
objective  function  of  the  follower.  Given  this 
notation,  the  linear  mixed  integer  BLPP  can  be  written 


P(x,y)  =  c 

11  1  12  2  ^  21  1  22  2 
x+cx+cy+cy 

(6.1a) 

where  y 

solves 

Max  f(x,y) 

.11  1  ,  .12  2  ,  ,21  1  .22  2 
=  d  x  +  d  x  +  d  y  +  d  y 

(6.1b) 

y 

subject  to 

11  22  11  22 

Ax  +  Ax  +  By  +  By  <  b 

(6.1 c) 

12  12 

x  ,  x  ,  y  ,  y  >  0  (6. Id) 

2  2 

x  ,  y  integer  (6.1e) 

where  c11 111  and  d11  are  n1  ^dimensional  row  vectors,  c12 

12  12  21  21 
and  d  are  n  -dimensional  row  vectors,  c  and  d  are 

21  22  22  22 
n  -dimensional  row  vectors,  c  and  d  are  n 

dimensional  row  vectors,  b  is  an  m-dimensional  column 

1  11  2  12 
vector,  A  an  m  x  n  matrix,  A  is  an  m  x  n  matrix, 

1  21  2  22 
B  is  an  m  x  n  matrix,  and  B  is  an  m  x  n  matrix. 

Once  again,  because  x  is  fixed  before  f(x,y)  is 

111  122 

maximized,  the  terms  d  x  and  d  x  can  be  omitted  from 

the  follower's  objective  function  without  affecting  the 

2 

solution  of  (6.1).  If  the  integer  restrictions  on  x 


o 

and  y  are  relaxed,  (6.1)  becomes  a  linear  BLPP,  and  the 
techniques  developed  in  Chapter  5  can  be  used  to  find 
the  solution  of  the  relaxed  BLPP.  This  trait  will  be 
utilized  in  creating  an  algorithm  for  the  mixed  integer 
BLPP.  In  the  remainder  of  the  chapter,  obstacles  to 
algorithmic  development  presented  by  the  mixed  integer 
BLPP  are  explained,  an  algorithm  is  presented  and 
discussed,  heuristics  for  solving  the  mixed  integer  BLPP 
are  developed,  an  example  is  presented,  and 
computational  results  are  given. 

6.2  Obstacles  to  Algorithmic  Development 

Geoff rion  and  Marsten  (1972)  have  identified  three 
key  notions  in  the  development  of  algorithms  which  solve 
mixed  integer  programming  problems.  They  are 
separation,  relaxation,  and  fathoming.  These  three 
notions  are  the  cornerstone  of  the  algorithm  developed 
to  solve  the  mixed  integer  BLPP.  Separation,  which  is 
accomplished  by  placing  contradictory  constraints  on  a 
single  integer  variable,  can  be  applied  to  the  mixed 
integer  BLPP.  Relaxation,  where  all  integrality 
requirements  on  the  variables  are  dropped,  can  also  be 
applied.  When  the  integrality  requirements  are  dropped 
from  the  mixed  integer  BLPP,  a  linear  BLPP  results,  and 


this  linear  BLPP  can  be  solved  using  the  algorithm 
presented  in  Chapter  5.  However,  fathoming  presents 
several  difficulties.  In  mixed  integer  programming , 
candidate  problems  or  subproblems  are  created  by 
separation.  Relaxation  is  done,  and  some  technique  is 
employed  to  determine  if  the  set  of  solutions  of  the 
relaxed  subproblem  does  not  include  the  optimal 
solution.  If  it  can  be  ascertained  that  the  set  of 
solutions  of  the  relaxed  subproblem  does  not  include  a 
feasible  solution  better  than  the  incumbent  solution  or 
the  best  feasible  solution  yet  found,  then  the 
subproblem  can  be  removed  from  further  consideration  or 
fathomed.  Geoff rion  and  Marsten  identify  three  general 
types  of  fathoming.  The  first  type  is  done  when  the 
relaxed  subproblem  has  no  feasible  solution.  The  second 
occurs  when  the  solution  of  the  relaxed  subproblem  is 
less  than  the  value  of  the  incumbent  solution.  The 
third  type  of  fathoming  happens  when  the  solution  of  the 
relaxed  subproblem  is  a  feasible  solution  of  the 
subproblem. 

For  the  mixed  integer  BLPP,  the  first  type  of 
fathoming  is  applicable,  the  second  type  of  fathoming 
can  be  done  but  the  modifications  required  to 


accommodate  the  mixed  integer  BLPP  make  it  very  weak, 
and  the  third  type  of  fathoming  cannot  be  applied.  This 
is  demonstrated  in  the  following  examples. 


Example  6 . 1 

Max  F(x,y)  =  x  +  lOy  where  y  solves 
x 

Max  f (x,y )  =  -y 
Y 

subject  to  -25x  +  20y  <  30 
x  +  2y  <  10 
2x  -  y  <  15 
2x  +  10y  >  15 
X,  Y  >  0 

x,  y  integer 

The  feasible  region  of  this  example  is  shown  in  Figure 
6.1.  The  solution  of  this  problem  when  the  integrality 
requirements  are  relaxed  is  (x,y)  =  (8,1)  with  F(x,y)  = 
18.  This  solution  is  also  in  the  inducible  region  of 
Example  6.1.  If  this  example  were  solved  using  a  branch 
and  bound  process,  it  would  seem  reasonable  to  terminate 
the  tree  at  vertex  0  since  the  solution  of  the  relaxed 
problem  satisfies  the  integrality  requirements  and  is  in 
the  inducible  region.  However,  if  the  integrality 


requirements  are  enforced,  the  optimal  solution  is 
(x*,y*)  =  (2,2)  with  F(x*,y*)  =  22.  This  example  shows 
that  the  solution  of  the  relaxed  BLPP  may  be  less  than 
the  solution  of  the  mixed  integer  BLPP  so  that  the 
former  does  not  provide  a  reliable  bound  on  the  solution 
of  the  mixed  integer  BLPP.  The  example  also 
demonstrates  that  a  solution  which  satisfies  the 
integrality  requirements  and  is  in  the  inducible  region 
of  the  problem  cannot  be  fathomed  in  a  branch  and  bound 
approach. 

The  following  example  illustrates  the  situation 
where  the  solution  of  a  relaxed  subproblem  satisfies  the 
integrality  requirements  but  is  not  in  the  inducible 
region  of  the  mixed  integer  BLPF . 

Example  6 . 2 

Max  F(x,y)  =  -x  -  2y  where  y  solves 

x 


Max  f ( x 

y 

,Y) 

=  y 

subject 

to 

-X 

+ 

2 . 5y 

< 

3.75 

X 

+ 

2 . 5y 

> 

3.75 

2 . 5x 

+ 

y 

< 

8.75 

x,  y 

> 

0 

X, 


~M0 


y  integer 


As  shown  in  Figure  6.2,  the  feasible  region  of  Example 
6.2  contains  three  integer  points.  They  are  (2,1), 
(2,2),  and  (3,1).  If  the  leader  picks  x  =  2,  the 
follower  chooses  y  =  2,  so  F  =  -6.  If  the  leader's 
decision  is  x  =  3,  the  follower's  choice  is  y  =  1,  so  F 
=  -5.  Therefore,  the  optimal  solution  of  the  problem  is 
(x* ,y* )  =  (3,1)  with  F  =  -5. 

Now  consider  a  separation,  relaxation,  and 
fathoming  approach  to  Example  6.2  using  a  depth  first 
search.  Separation  is  done  by  forming  subproblems  with 
contradictory  constraints  on  a  single  integer  variable, 
and  relaxation  is  accomplished  by  ignoring  the 
integrality  requirements  on  the  variables.  Thus,  each 
subproblem  is  a  mixed  integer  BLPP  with  tighter  bounds 
placed  on  the  integer  variables.  To  facilitate  the 
presentation,  a  branch  and  bound  tree  is  used.  The 
contradictory  constraints  appear  on  the  branches  of  the 
tree,  and  the  vertices  of  the  tree  represent  the 
subproblems  formed  by  adding  the  constraints  along  the 
branches  to  the  problem.  The  branching  is  done  on  a 
variable  with  a  fractional  part  and  is  done  in  the  > 
direction.  The  tree  is  presented  in  Figure  6.3. 


(X,Y)  Solutions 


(0,1.5) (  0 


Y  >  2 


Y  <  1 


(1.25,2)  (  1 


X  >  2 


6  )  (1.25,1) 


X  <  1 


(2,2.3) 


Y  >  3, 


kY  <  2 


F  =  -6 


X  >  2 


(3.45,0.12)  (  7 


X  >  4 


X  <  1 


X  <  3 


9  )  (2,1)  * 


X  >  3> 


10  )  (3,1) 


F  =  -5 


^Integer  valued  but  not  in  the  inducible  region 
of  the  BLPP . 


Figure  6.3:  Branch  and  Bound  Tree  for  Example  6.2 
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At  vertex  0,  the  solution  of  the  relaxation  of  Example 
6.2  is  (x,y)  =  (0,1.5)  with  F  =  -3.  Separating  on  the  y 
variable  and  adding  the  constraint  y  >  2  to  Example  6.2 
yields  the  subproblem  at  vertex  1 .  Solving  the 
relaxation  of  the  subproblem  at  vertex  1  yields  the 
solution  (x,y)  =  (1.25,2)  with  F  =  -5.25.  Separating  on 
the  variable  x  and  adding  the  constraint  x  >  2  to  the 
subproblem  at  vertex  1  produces  a  more  constrained 
subproblem  at  vertex  2.  The  solution  of  the  relaxation 
of  the  subproblem  at  vertex  2  is  (x,y)  =  (2,2.3)  with  F 
=  -6.6.  Separating  on  the  variable  y  and  adding  the 
contradictory  constraints  y  >  3  and  y  <  2  produce, 
respectively,  the  subproblems  at  vertices  3  and  4.  The 
subproblem  at  vertex  3  is  infeasible.  Proceeding  to  the 
unexplored  subproblem  at  vertex  4,  relaxing,  and  solving 
gives  (x,y)  =  (2,2)  with  F  =  -6.  This  solution  is  in 
the  inducible  region  of  the  subproblem  at  vertex  4  and 
is  also  in  the  inducible  region  of  Example  6.2,  so  the 
solution  (x,y)  =  (2,2)  becomes  the  incumbent  solution. 

At  vertex  4,  the  subproblem  has  constraints  on  y  which 
force  y  =  2.  Given  y  =  2,  the  leader's  decision  is  x  = 
2.  This  allows  fathoming  of  the  subproblem  at  vertex  4, 
and  backtracking  in  the  tree  leads  to  the  infeasible 


i'± 
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subproblem  at  vertex  5 .  Backtracking  again  returns  to 
the  problem  at  vertex  0.  Adding  the  contradictory 
constraint  y  <  1  creates  the  subproblem  at  vertex  6. 

The  solution  of  its  relaxation  yields  F  =  -3.25  with 
(x,y)  =  (1.25,1).  Separating  on  the  x  variable  creates 
the  subproblem  at  vertex  7  with  the  constraint  x  >  2 
added.  The  solution  of  the  relaxed  subproblem  at  vertex 
7  is  (x,y)  =  (3.45,0.12)  with  F  =  -3.69.  Separating  on 
x  and  adding  the  constraint  x  >  4  produces  an  infeasible 
subproblem  at  vertex  8.  Backtracking  and  adding  the 
contradictory  constraint  x  <  3  to  the  subproblem  at 
vertex  7  gives  the  subproblem  at  vertex  9.  Its  solutioi 
is  (x,y)  =  (2,1)  with  F  =  -4 .  This  is  in  the  inducible 
region  of  the  subproblem  at  vertex  9.  However,  (x,y)  = 

(2.1)  is  not  in  the  inducible  region  of  Example  6.2,  and 
if  the  subproblem  at  vertex  9  is  fathomed,  the  optimal 
solution  is  not  found.  The  variable  x  must  be  further 
constrained  in  order  to  uncover  the  optimal  solution  of 
Example  6.2.  The  subproblem  at  vertex  10  with  the 
constraint  x  >  3  added  must  be  explored.  Solving  the 
relaxation  of  this  subproblem  gives  the  solution  (x,y)  = 

(3.1)  with  F  =  -5.  This  is  in  the  inducible  region  of 
the  subproblem  at  vertex  10  and  is  also  in  the  inducible 


region  of  Example  6.2.  As  previously  shown,  this  is 
also  the  optimal  solution  of  Example  6.2.  Backtracking 
adds  vertex  11  to  the  branch  and  bound  tree.  The 
subproblem  at  vertex  11  is  infeasible,  and  the  branch 
and  bound  tree  is  complete. 

Thus,  Example  6.2  demonstrates  that  a  solution  in 
the  inducible  region  of  a  subproblem  may  not  be  in  the 
inducible  region  of  the  original  problem  and  that  a 
subproblem  cannot  be  fathomed  when  a  solution  satisfies 
the  integrality  requirements  but  is  not  in  the  inducible 
region  of  the  original  problem.  At  vertex  7,  if  y  had 
been  selected  as  the  branching  variable,  the  optimal 
solution  would  not  have  been  found. 

These  two  examples  show  that  a  subproblem  cannot  be 
fathomed  when  the  solution  of  its  relaxation  satisfies 
the  integrality  requirements  or  is  in  the  inducible 
region  of  the  original  problem.  These  examples  also 
show  that  the  solution  of  the  relaxed  problem  cannot  be 
used  as  an  upper  bound  on  the  solution  of  the  mixed 
integer  BLPP. 

As  stated  earlier,  the  second  type  of  fathoming  can 
be  applied  in  solving  the  mixed  integer  BLPP.  The 
second  type  of  fathoming  may  be  done  when  the  value  of 


the  solution  of  a  relaxed  subproblem  is  less  than  the 
value  of  the  incumbent  solution.  However,  for  the  mixed 
integer  BLPP  where  the  relaxation  is  limited  to  the 
dropping  of  the  integrality  requirements.  Examples  6.1 
and  6.2  show  that  if  this  type  of  fathoming  is  done,  the 
optimal  solution  of  the  mixed  integer  BLPP  may  not  be 
found.  However,  further  relaxation  of  a  subproblem  does 
permit  this  type  of  fathoming  to  be  done.  Before 
discussing  this  situation,  some  definitions  and  notation 
are  presented. 

6.3  Definitions  and  Notation 

Before  formally  presenting  the  situation  where  the 
second  type  of  fathoming  is  applicable,  some  notation 
and  definitions  must  be  presented.  Let 

1  2 

N  =  (l,...,n  +n  >  be  the  index  set  of  the 
variables ; 

1  12 

N  =  {l,...,n  }  be  index  set  of  the  integer 

2 

variables,  x  ,  controlled  by  the  leader; 

2  22 

N  ={l,...,n  }be  the  index  set  of  integer 

2 

variables,  y  ,  controlled  by  the  follower. 

The  initial  upper  bounds  placed  on  the  integer  variables 

of  (6.1),  the  mixed  integer  BLPP,  are  defined  by  the 

1  12 

following  vectors.  U  is  an  n  -dimensional  vector  of 


upper  bounds  on  the  integer  variables  controlled  by  the 
2  22 

leader,  and  U  is  an  n  -dimensional  vector  of  upper 
bounds  on  the  integer  variables  controlled  by  jhe 
follower.  If  an  integer  variable  is  unbounded  above, 
then  the  corresponding  entry  in  the  upper  bound  vector 
is  oo.  The  initial  lower  bound  on  each  integer  variable 
of  (6.1)  is  assumed  to  be  zero.  For  subproblem  k,  the 
sets  of  bounds  on  the  variables  are 

l  lk  lk  lk  2  lk  1  1 

Hk  "  <<«  )  I  0  <  ctj  <  Xj  <  p*K  <  V*,  j  €  n  ) 

„2  . ,  2k  „2k,  .  .  2k  ,  2  _  „2k  .  „2  „2. 

-  {(a  ,p  )  |  0  <  <Xj  <  y^  <  pj  <  Uj,  j  €  N  ) 

lk  lk  12 

where,  for  subproblem  k,  a  and  p  are  n  -dimensional 

vectors  of  lower  and  upper  bounds,  respectively,  placed 

on  the  integer  variables  controlled  by  the  leader,  and 
2k  2k  22 

a  and  p  are  n  -dimensional  vectors  of  lower  and 

upper  bounds,  respectively,  placed  on  the  integer 

variables  controlled  by  the  follower.  When  no  positive 

lower  bound  has  been  placed  on  an  integer  variable  of 

subproblem  k,  then  the  entry  in  the  appropriate  lower 

bound  vector  is  zero.  Also,  for  subproblem  k,  the 
2 

notation  11^(0,00)  is  used  to  indicate  that  no  bounds 
other  than  the  original  bounds  imposed  in  the  mixed 


integer  BLPP  (6.1)  are  placed  on  the  integer  variables 

controlled  by  the  follower.  In  addition,  the  notation 

hJeh£  means  alk<a1A  and  p1A<Blk. 

The  index  sets  of  the  integer  variables  which  are 

restricted  in  subproblem  k  are 

_1  , .  .  Ik  _  -  _lk  „  „1  .  „1 , 

Sfc  =  (j  |  >  0  or  pj  <  Uj,  j  €  N  } 

_2  ...  2k  _  -  _2k  „  „2  „2, 

=  {j  |  <Xj  >  0  or  Pj  <  Uj,  3  e  N  }. 

1  2 

As  implied  by  the  definition  of  Sk  and  Sfc,  a  restricted 

variable  is  a  variable  which  has  an  additional  lower  or 

upper  bound  placed  on  it  in  subproblem  k.  When  a 

variable  is  referred  to  as  restricted,  this  means 

constraints  or  bounds  other  than  those  found  in  (6.1) 

are  placed  on  the  variable. 

As  noted  in  the  previous  section,  the  second  type 

of  fathoming  may  be  done  if  a  subproblem  is  sufficiently 

relaxed.  The  relaxed  BLPP  is  the  BLPP  derived  from  the 

mixed  integer  BLPP  by  dropping  the  integrality 

requirements.  The  following  notation  is  used  to 

designate  the  solution  of  the  relaxed  BLPP.  Define 
C 

Fk  as  the  optimal  solution  of  the  relaxed  or  continuous 

Q 

BLPP  at  subproblem  k.  Fk  is  found  by  dropping  the 


Ji'A'.H' •«»  #,*  (•*> '  k* J*b  iVlS'ifa'iVita' 


integrality  requirements  of  subproblera  k  and  solving  the 
resulting  BLPP  where  all  variables  are  continuous.  The 
BLPP  which  is  solved  to  find  is 


„  .  11  1  12  2  21  1  22  2 
Max  F(x,y)  =  c  x  +  c  x  +c  y  +  c  y 


where  y  solves 


(6.2a) 


Max  f ( x , y )  = 

,  ^  X  X  ,44  L. 

d  y  +  d  y 

(6.2b) 

Y 

subject  to 

A1x1  +  A2x2  +  B1y1 

+  B2y2  < 

b 

(6.2c) 

1  2 

1  2 

X  ,  X  , 

< 

i 

i 

IV 

0 

(6. 2d) 

and  the  bounds 

and  H2 

( 6 . 2e) 

As  shown  in  Chapter  5 ,  the  BLPP  can  be  restated  in  an 
equivalent  form  which  utilizes  the  Kuhn-Tucker 
conditions  of  the  follower's  problem.  If  the  BLPP  is 
relaxed  by  dropping  the  Kuhn-Tucker  conditions,  the 
solution  of  the  resulting  problem  is  called  the  "high 
point"  solution  of  the  relaxed  BLPP.  Problem  (6.3) 
illustrates  the  problem  which  is  solved  to  find  the 
"high  point"  solution  of  subproblem  k. 


subject  to  A1x1  +  A2x2  +  B3^1  +  B2y2  <  b  (6.3b) 

1  2  1  2  .  „  n  . 
x  ,  x  ,  y  ,  y  >0  (6.3c) 

1  2 

and  the  bounds  and  (6.3d) 

The  above  problem  is  referred  to  as  the  high  point 

H 

problem.  Define  Ffc  as  the  "high  point"  solution  of  the 
high  point  problem  derived  from  subproblem  k  and  note 
that  problem  (6.3)  is  derived  from  the  relaxed  BLPP 
(6.2)  . 

6.4  Bounds  which  Allow  the  Second  Type  of  Fathoming 

Two  theorems  and  one  corollary  are  presented.  They 
state  the  conditions  that  must  be  satisfied  so  that  the 
solution  of  a  relaxed  subproblem  may  be  used  as  a  bound 
on  the  value  of  the  mixed  integer  BLPP .  The  bound 
allows  fathoming  of  a  subproblem  when  the  value  of  the 
bound  is  less  than  or  equal  to  the  value  of  the 
Incumbent  solution. 

Before  presenting  the  theorems  and  corollary,  a 
method  which  allows  easy  and  simple  presentation  of  the 
subproblems  is  required.  Branch  and  bound  provides  a 


means  to  keep  track  of  the  subproblems  and  the 

contradictory  constraints  which  are  added  to  (6.1). 

Each  vertex  of  the  branch  and  bound  tree  represents  a 

new  subproblem,  and  each  branch  of  the  tree  represents 

an  added  constraint  on  one  of  the  integer  variables.  If 

vertex  k  is  along  the  path  to  vertex  i. ,  this  means  the 

subproblem  associated  with  vertex  £  is  derived  from  the 

11  2  2 

subproblem  associated  with  vertex  k,  so  and  H^EH^ . 

Theorem  6 . 1  Given  H*  and  h£(0,co),  let  (xk,yk)  be  the 

high  point  solution  to  the  corresponding  relaxed  BLPP. 

H  1c  1c 

Then  =  F(x  )  is  an  upper  bound  on  the  solution  of 
the  mixed  integer  BLPP  at  vertex  k. 

*£  *  i 

Proof :  Let  (x  )  solve  the  mixed  integer  BLPP  at 

vertex  l  where  H*EH^  and  H^SH^(0,oo).  Assume  F(x  *,y  *) 

>  F^.  However,  this  leads  to  a  contradiction  because 
(x  )  is  a  feasible  solution  of  the  high  point 

problem  at  vertex  k.  i 

This  result  says  that  the  high  point  solution  at  vertex 
k  may  be  used  as  a  bound  in  determining  if  the 
subproblem  at  vertex  k  can  be  fathomed.  Unfortunately, 


this  bound  is  only  applicable  when  no  restrictions  on 

the  integer  variables  controlled  by  the  follower  have 

been  made  along  the  path  to  vertex  k.  Thus,  Theorem  6.1 

does  not  hold  if  the  path  to  vertex  k  contains  a 

restriction  on  one  of  the  integer  variables  controlled 

by  the  follower;  this  means  Theorem  6.1  does  not  hold  if 
2 

S  ^  pt  <p .  The  reason  for  this  is  that  the  follower  does 

not  have  to  adhere  to  any  restrictions  placed  on  his 

variables  in  the  restricted  subproblems.  Once  the 

leader  has  made  a  decision,  the  follower  optimizes  his 

objective  function  without  regard  to  the  restrictions, 

2 

Sfc,  placed  on  the  variables  he  controls.  Nevertheless, 

H 

the  following  theorem  indicates  when  Ffc  provides  a  valid 
upper  bound  for  the  case  where  restrictions  have  been 
placed  on  the  integer  variables  controlled  by  the 
follower . 

Theorem  6 . 2  Given  and  H^,  let  (xk,yk)  be  the  high 

point  solution  to  the  corresponding  relaxed  BLPP.  Then 
H  k  k 

Ffc  =  F(x  )  is  an  upper  bound  on  the  mixed  integer 
BLPP  defined  by  the  current  path  in  the  tree  if  none  of 
the  y^  are  at  either  a*  >0  or  p*  <Uj  for  3  €  Sk- 


Proof ;  Let  (x  £,X  £)  solve  the  mixed  integer  BLPP  at 

vertex  l  where  H^SH^  and  H^SH^.  Assume  F(x  £,X  £)>F^. 

Thus  (x  £,X  *)  cannot  be  feasible  to  the  high  point 

problem  at  vertex  k.  Now  construct  the  line  joining 

(xk,Xk)  an d  (x  l)  as  follows:  let  (x,y)  = 

Y(xk,xk)+< 1-Y) (x*£ ,X*£)  >  V€[0,1].  So  for  y>0,  F(x,y)  = 

S,t^(5k'Xk)  +  (1-Y)(5*4.X*£)3  =  YF(xk,Xk)  +  (1-y)F(x*£,X*£) 

*1  *1  H 

since  F  is  linear.  It  is  assumed  F(x  ,X  )>Fic'  30 
YF(xk,Xk)  +  (1-Y)F(x*\X*£)  >  YF(xk,Xk)  +  ( l-Y)F(xk,Xk) 
»F(xk,Xk).  Thus,  F(x,y) >F(xk,Xk) .  However,  this 
contradicts  the  optimality  of  (xk,Xk)  because  for  y 
sufficiently  small,  (x,y)  is  feasible  to  the  high  point 
problem.  ■ 


The  weakness  of  Theorem  6.2  arises  from  the  fact  that 
the  conditions  required  for  the  theorem  to  be  true  will 
not  usually  hold.  In  solving  for  the  high  point 
solution,  the  requirement  that  none  of  the  restricted 
integer  variables  controlled  by  the  follower  be  at  a 
bound  will  usually  be  violated.  However,  the  following 
corollary  provides  a  way  to  always  find  a  bound  which 


may  be  used  to  do  fathoming. 


Corollary  6.1  Given  and  H^,  let  (x^y^)  be  the  high 

point  solution  of  the  corresponding  relaxed  BLPP  with 

2  h  k  k 

the  restrictions  of  relaxed.  Then  Fk=F(x  ,  y  )  is  an 
upper  bound  on  the  mixed  integer  BLPP  defined  by  the 
current  path  in  the  tree. 

2 

Proof :  Relaxing  the  restrictions  of  is  equivalent  to 

2  2 

replacing  with  11^(0,00).  Thus,  Theorem  6.1  applies.  ■ 

In  Corollary  6.1,  problem  (6.3)  is  modified  before  the 
high  point  solution  is  found.  This  modification 
requires  a  change  in  the  constraints  of  (6.3d).  The 

2 

modification  is  the  relaxing  of  the  restrictions  of  H^. 
Thus,  the  problem  of  interest  in  Corollary  6.1  is 


Max  F(x,y) 
x,Y 

11  1  , 

=  C  X  + 

c12x2  +  c2V 

.  22  2 
+  c  y 

(6.4a) 

subject 

4-  »1  1 

to  Ax 

+  A2x2  +  B1y1 

2  2 
+  By 

<  b 

(6.4b) 

1  2 
x  ,  x  , 

1  2 
y  »  Y 

>  0 

(6.4c) 

and 

the  bounds 

and  H2(0,oo) 

( 6 . 4d ) 

The  bounds  presented  above  are  weak.  In  the  BLPP, 
once  the  leader  has  made  his  decision,  the  follower  is 


free  to  respond  without  regard  to  any  restrictions  used 
to  reach  the  leader's  decision.  This  precludes  the  use 
of  tighter  bounds  in  finding  the  solution  of  the  mixed 
integer  BLPP. 

6 . 5  A  Modification  of  the  Algorithm  which  Solves 

the  BLPP 

In  Chapter  5,  an  algorithm  is  developed  which 
solves  the  BLPP.  This  algorithm  applies  a  branch  and 
bound  approach  to  an  equivalent  representation  of  the 
BLPP.  This  representation  is  derived  by  using  the  Kuhn- 
Tucker  conditions  of  the  follower's  problem.  The 
stationarity  conditions  are  then  added,  and  a  branch  and 
bound  procedure  is  applied  to  find  solutions  that 
satisfy  the  complementary  slackness  conditions.  This 
algorithm  can  be  used  to  solve  the  relaxed  mixed  integer 
BLPP.  However,  when  there  are  restrictions  on  the 
Integer  variables  controlled  by  the  follower,  the 
algorithm  that  solves  the  BLPP  must  be  modified  before 
it  can  be  used  to  solve  the  relaxed  mixed  integer  BLPP. 
The  modification  is  given  by  the  following  proposition. 
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Proposition  6.1:  When  solving  the  relaxed  mixed  integer 
BLPP,  the  complementary  slackness  condition  associated 
with  an  integer  variable  controlled  by  the  follower 
should  be  ignored  when  that  variable  is  at  an  upper 
bound . 

Proposition  6.1  means  that  if,  in  solving  the  relaxed 

2k  2k  2 

mixed  integer  BLPP  at  vertex  k,  y^  =  “  Uj  for  ^  6 

2 

N  ,  then  in  the  algorithm  which  solves  the  BLPP,  the 
complementary  slackness  condition  associated  with  that 
variable  should  be  relaxed  (ignored).  Example  6.3 
illustrates  when  this  situation  arises. 

Example  6.3 

Max  F(x,y)  =  -2x  +  15y  where  y  solves 
x 

Max  f (y )  =  -lOy 

y 

subject  to  x  >  19.25 

y  <  14 

11. 3x  -  7 . 8y  <  116 

x,  y  >  0 

y  integer. 

A  graph  of  the  feasible  region  of  Example  6.3  appears  in 
Figure  6.4.  When  the  integrality  requirement  on  y  in 
Example  6.3  is  dropped,  the  relaxed  mixed  integer  BLPP 


can  be  rewritten  using  the  Kuhn-Tucker  approach.  Its 
equivalent  representation  is 


Max  F(x,y)  =  -2x  +  15y 
x,y,u 

(6.5a) 

subject  to  x 

> 

19 .25 

(6.5b) 

V 

< 

14 

(6.5c) 

11 . 3x  -  7 . 8y 

< 

116 

( 6 . 5d ) 

-Uj.  +  7-8u2  +  U3 

= 

10 

( 6 . 5e ) 

u2 ( 14  -  y) 

= 

0 

(  6 . 5f  ) 

u2(116  -  11. 3x  +  7.8y) 

= 

0 

(6.5g) 

u3(y) 

= 

0 

( 6 . 5h) 

x,  y,  Uj,  u2,  u3 

> 

0 

(  6 . 5i  ) 

where  u  is  the  Kuhn-Tucker  (KT)  multiplier  associated 
with  (6.5c),  u2  is  the  KT  multiplier  associated  with 
(6.5d),  and  u3  is  the  KT  multiplier  associated  with  the 
nonnegativity  requirement  of  y.  When  the  algorithm  of 
Chapter  5  is  applied  to  the  above  problem,  the  solution 
is  (x*,y*)  =  (19.9292,14)  with  F  =  170.14.  However,  if 
the  leader  chooses  x  =  19.25,  and  the  integrality 
requirement  on  the  follower's  response  is  enforced,  the 
follower's  decision  is  y  =  14.  For  (x,y)  =  (19.25,14), 
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F  =  171.5.  The  algorithm  does  not  reach  the  point 
(19.25,14)  because  the  stationarity  condition  (6.5e) 
requires  u2  or  u3  to  be  positive.  If  ug  is  positive,  y 
must  be  zero  to  satisfy  the  complementary  slackness 
condition  (6.5h).  This  is  not  feasible,  so  u2  takes  on 
positive  value.  The  complementary  slackness  condition 
(6.5g)  associated  with  u2  requires  the  constraint  (6.5d) 
to  be  tight,  and  x  must  be  19.9292  in  order  to  satisfy 
this  requirement.  However,  if  the  complementary 
slackness  condition  (6.5h)  associated  with  y  is  relaxed, 
the  solution  is  (x,y)  *  (19.25,14).  This  happens 
because  both  u3  and  y  can  have  values  greater  than  zero. 
Since  u3  can  be  greater  than  zero,  this  allows  u2  to 
assume  a  value  of  zero  which  means  constraint  (6.5d) 
does  not  have  to  be  tight.  Thus,  when  an  upper  bounded 
integer  variable  controlled  by  the  follower  is  at  its 
upper  bound,  the  complementary  slackness  condition 
associated  with  this  variable  in  the  equivalent 
representation  of  the  relaxed  mixed  integer  BLPP  must  be 
relaxed . 

This  requires  a  slight  change  in  Step  3  of  the 
algorithm  which  solves  the  BLPP.  Step  3  is 


t 


Step  3:  (Branching)  If  u^*g1(xk,yk)  =  0,  i=l , . . . ,m+n2 , 
go  to  Step  4;  otherwise,  select  i  for  which 

If  If  If 

Ui*9i*x  ^  ls  lar9est  and  label  it  i  .  Put 

Sk  Sk  U  Sk  Sk  ^  {ii>'  sk  **  sk'  and  9° 

to  Step  1. 

The  modified  step  is 

if  2 

Step  3:  (Branching)  If  y  ^  ,  j=l,..,n  ,  is  an  integer 

variable  at  its  upper  bound,  then  delete  the  i 

from  the  list  i=l , . . . ,m+n  which  corresponds  to 

this  variable's  complementary  slackness 

condition.  If  uk* gA (xk, yk)  =  0,  1=1 , . . . ,m+n2 , 

go  to  Step  4;  otherwise,  select  i  for  which 
1c  1c  1c, 

ui*gi^x  ,y  ^  is  lar9est  and  label  it  i  .  Put 

Sk  Sk  U  Sk  Sk  ^  sk  Sk'  and  go 

to  Step  1. 

This  modification  allows  the  leader  to  take  advantage  of 
the  integrality  requirement  on  variables  controlled  by 
the  follower.  With  this  modification  to  the  algorithm 
for  solving  the  BLPP,  an  algorithm  which  finds  feasible 
solutions  of  the  mixed  integer  BLPP  can  be  presented. 


*1  *  t 


6 . 6  An  Algorithm  for  the  Mixed  Integer  BLPP 


The  algorithm  developed  for  solving  the  mixed 


integer  BLPP  takes  a  branch  and  bound  approach  which 


utilizes  a  standard  branching  procedure.  On  each  pass 


through  the  algorithm,  an  integer  variable  which  is 


fractional-valued  in  the  solution  of  the  relaxed  mixed 


integer  BLPP  is  selected,  and  separation  is  based  on 


this  variable.  When  separation  is  accomplished,  two 


subproblems  are  created.  The  subproblems  are  generated 


by  adding  alternative  constraints  on  the  selected 


integer  variable.  Assuming  x*  is  the  selected  integer 


2  2 

variable,  the  alternative  constraints  are  x^  <  |_XjJ  and 


2  2 

Xj  >  LXjJ+1  where  L*J  represents  the  greatest  integer 


value  less  than  or  equal  to  that  of  the  selected 


variable.  Adding  these  constraints  is  equivalent  to 


placing  bounds  on  the  integer  variables,  so  in  the 


algorithm,  the  alternative  constraints  are  added  by 


placing  bounds  on  the  integer  variables.  By  treating 


the  added  constraints  as  bounds,  the  algorithm  can  use 


12  1  2 

Hk'  Hk'  Sk'  and  Sk  to  do  ttie  bookkeePin9  required  to 


maintain  the  branch  and  bound  tree.  Fathoming  is  done 


when  the  relaxed  BLPP  is  infeasible  or  when  the  upper 


bound  on  the  mixed  integer  BLPP  at  a  vertex  is  less  than 


.u  j. 


the  value  of  the  current  incumbent  solution.  By 

applying  Corollary  6.1,  the  high  point  solution  is  used 

as  an  upper  bound  on  the  solution  of  the  subproblems. 

2 

That  is,  the  restrictions  or  bounds  of  placed  on  the 

integer  variables  controlled  by  the  follower  are  ignored 

in  finding  the  high  point  solution  at  vertex  k.  In  the 

algorithm,  F_  is  the  value  of  the  incumbent  solution.  A 

flow  chart  of  the  algorithm  is  shown  in  Figure  6.5.  As 

will  be  shown,  the  algorithm  cannot  find  the  optimal 

solution  of  all  mixed  integer  BLPPs.  However,  the 

algorithm  always  finds  a  solution  which  is  in  the 

inducible  region  of  the  mixed  integer  BLPP.  Also,  x 

1  2 

will  represent  the  vector  (x  ,x  ),  and  ^  will  represent 
1  2 

the  vector  (y  ,y  ) . 


6.6.1  The  Basic  Algorithm 


Step  0:  (Initialization)  Put  k=0 .  Set  the  bounds  of  Hfc 
2 

and  to  the  bounds  of  the  mixed  integer  BLPP. 
Put  s£=<f>,  s£=(*>,  F=-co . 


.f  ■  '  I*'. §**141* 


Step  1  : 


Step  2: 


Step  3: 


Step  4 : 


(High  Point  Solution)  Attempt  to  find  the  high 

JJ 

point  solution  of  (6.4)  and  calculate  Ffe.  If 
infeasible  or  <  F_,  go  to  Step  6. 

(Relaxed  Solution)  Attempt  to  solve  the  relaxed 

BLPP  (6.2).  If  infeasible,  go  to  Step  6.  If 

lc  1c 

successful,  label  the  solution  (x  ,  y  ). 

(Branching)  If  the  integer  requirements  of 

lc  lc 

(6.1)  are  satisfied  by  (x  ,y  ) ,  go  to  Step  4. 

Otherwise,  select  an  x2k,  jeN1,  or  y2k,  jeN2, 

which  is  fractional-valued.  Place  a  new  bound 

on  the  selected  variable.  Put  k  «-  k+1,  add  a 

live  vertex  to  the  branch  and  bound  tree,  and 
12  1  2 

update  H^,  H^,  S^,  and  S^.  Go  to  Step  1. 

If 

(Feasible  Point)  Fix  x  at  x  and  solve  the 

lc  *  lc 

follower's  problem  to  obtain  (x  ,y  ).  Compute 
F(xk,yk)  and  put  F=max[F_, F(xk,yk)  ]  . 


* 
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11c  Ik  1 

Step  5:  (Integer  Branching)  If  a*  =p^  ,  for  each  jeN  , 

2k  lk  2 

and  a*  =Pg  ,  for  each  jeN  ,  go  to  Step  6. 

Otherwise,  select  an  integer  variable  such  that 
lk  lk  1  2k  2k  2 

*J  '  j€N  '  °r  “j  *Pj  '  ‘}€N  '  aIid  place  3 
new  bound  on  it.  Put  k  «-  k+1 ,  add  a  live 

vertex  to  the  branch  and  bound  tree,  and  update 
Hk'  Hk'  Sk'  and  Sk*  Go  to  Step  1 - 

Step  6:  (Backtracking)  If  no  live  vertex  exists,  go  to 

Step  7.  Otherwise,  branch  to  the  newest  live 

12  1 

vertex,  put  k  <-  k+1,  and  update  H^,  Hk,  S^,  and 
2 

Sfe.  Go  to  Step  l. 

Step  7:  (Termination)  If  F=-co,  there  is  no  feasible 
solution  to  (6.1).  Otherwise,  terminate  with 
the  feasible  solution  associated  with  F_. 

1  2 

At  Step  0,  and  are  initialized  by  placing  the 

lower  bounds  on  the  integer  variables  in  the  vectors 
2 

and  and  the  upper  bounds  on  the  integer  variables  in 
1  2 

the  vectors  Pk  and  p^.  At  Step  1,  problem  (6.4)  is 
solved  to  find  the  high  point  solution  at  vertex  k.  If 
(6.4)  is  infeasible,  the  algorithm  goes  to  Step  6.  At 


;wmw/vmTivs(uwvw(v\f»  ,n. 


Step  2,  the  relaxed  BLPP  at  vertex  k  is  solved.  If  the 

relaxed  BLPP  does  not  have  a  feasible  solution,  the 

algorithm  skips  to  Step  6. 

At  Step  3,  many  rules  for  selecting  the  branching 

variable  were  considered.  The  rule  which  was  selected 

for  implementation  is  the  one  which  had  the  shortest 

average  CPU  time  for  10  test  problems.  So,  at  Step  3, 

if  at  least  one  integer  variable  has  a  fractional  value 

in  the  solution  found  at  Step  2,  branching  is 

accomplished.  The  variable  selected  for  branching  is 

the  integer  variable  with  the  largest  fractional  part. 

That  is,  the  variable  selected  for  branching  is  an 

2k  2k 

integer  variable  such  that  the  value  of  (x^  -  J) , 

1  2k  2k  2 

j€N  ,  or  (yj  -  LYj  J) .  j€N  ,  is  the  largest.  Suppose 
2  1 

x j ,  j€N  ,  an  integer  variable  controlled  by  the  leader, 
is  selected  as  the  branching  variable.  This  means  a  new 
bound  must  be  placed  on  this  variable.  If  the  selected 
variable's  coefficient  in  the  leader's  objective 

2 

functions  is  positive,  a  lower  bound  is  placed  on  x  ^  . 

2  2k 

The  new  lower  bound  is  x^  >  J+l.  If  the  coefficient 

2 

is  negative,  an  upper  bound  is  placed  on  x  ^  .  The  new 

2  2k 

upper  bound  is  x^  <  J*  The  vertex  counter,  k,  is 


'!* 

5* 
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incremented  by  1,  the  bound  vector,  either  a  or  p  , 


is  updated,  and  the  index  set  of  restricted  integer 


variables,  S^,  is  updated.  The  branching  is  designed  to 


make  the  variables  go  in  a  direction  which  will  provide 


increases  in  the  value  of  the  leader's  objective 


function.  A  similar  procedure  is  followed  if  the 


selected  variable  is  controlled  by  the  follower.  This 


adds  a  live  vertex  to  the  branch  and  bound  tree.  Live 


vertices  are  added  in  a  depth  wise  manner.  The 


algorithm  then  returns  to  Step  1.  If  no  integer 


variable  has  a  fractional  value,  then  the  integer 


requirements  of  problem  (6.1)  are  satisfied,  and  the 


algorithm  proceeds  to  Step  4. 


At  Step  4,  a  solution  in  the  inducible  region  of 


the  mixed  integer  BLPP  is  found.  The  variables 


controlled  by  the  leader  are  fixed  at  their  value  in  the 


solution  found  at  Step  2,  and  the  follower's  problem  is 


solved.  The  follower's  problem  is  a  mixed  integer 


12 

programming  problem  where  x  and  x  are  fixed.  Its  form 


is  shown  in  (6.6) 


k  k 

Since  the  solution  (x  )  satisfies  the  constraints  of 


(6.6),  the  mixed  integer  programming  problem  solved  at 


Step  4  must  have  a  feasible  solution.  The  solution  of 


w  .  21  1  ,  ,22  2 

Max  f(y)=  d  y  +  d  y 


(6.6a) 


subject  to  B1y1  +  B2y2  <  b  -  A^x1  -  A2  x2  (6.6b) 


y1,  y2  >  0  (6.6c) 


y  integer 


(  6 . 6d ) 


(6.6),  (xk,yk) ,  is  a  solution  of  (6.1),  and  if  it  is 


greater  than  the  current  incumbent  solution,  it  becomes 
the  incumbent  solution.  As  shown  earlier  in  Examples 
6.1  and  6.2,  fathoming  cannot  be  performed  when  a 
solution  satisfying  the  integer  requirements  has  been 
found,  so  the  algorithm  goes  to  Step  5. 

At  Step  5,  an  integer  variable  is  selected  for 
branching.  The  integer  variable  selected  is  one  whose 
upper  and  lower  bounds  at  vertex  k  are  not  equal  to  each 
other.  Since  the  integer  requirements  of  (6.1)  are 
satisfied  when  the  algorithm  reaches  Step  5,  determining 
the  variable  on  which  to  branch  is  somewhat  arbitrary. 
The  method  used  by  the  algorithm  involves  the  use  of  a 
list.  The  first  integer  variable  in  the  list  whose 
upper  and  lower  bounds  at  vertex  k  are  not  equal  is 
selected  as  the  branching  variable.  The  selected 
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variable  is  then  placed  at  the  bottom  of  the  list.  The 
reason  for  this  approach  is  explained  in  the  section  on 
computational  results.  Once  a  variable  is  selected,  a 
new  bound  is  placed  on  it.  The  method  used  is  the  same 
as  the  one  used  in  Step  3.  If  the  variable's 
coefficient  in  the  leader's  objective  function  is 
positive,  a  lower  bound  is  placed  on  the  variable,  and 
if  its  coefficient  is  negative,  an  upper  bound  is  placed 
on  the  variable.  Also,  the  updating  performed  at  Step  5 
is  the  same  as  that  done  at  Step  3.  Again,  a  live 
vertex  is  added  to  the  branch  and  bound  tree  in  a  depth 
wise  fashion.  Once  a  variable  has  been  selected  for 
branching  and  the  updating  has  been  accomplished,  the 
algorithm  returns  to  Step  1.  If  all  the  integer 
variables  are  fixed  in  the  branch  and  bound  tree,  the 
algorithm  goes  to  Step  6. 

At  Step  6,  the  algorithm  backtracks.  Once  again, 
to  facilitate  bookkeeping,  the  path  in  the  branch  and 
bound  tree  can  be  represented  by  an  ^-dimensional  vector 
where  Jt  is  the  current  depth  of  the  tree.  The  order  of 
the  components  is  determined  by  their  "level"  in  the 
tree.  Indices  only  appear  in  the  vector  if  they  are 
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in  or  si- 


1  2 

If  jeS^  or  jeS^,  let  it  appear  in  as 

j  if  jeS*  and  variable  j  has  an  upper  bound; 

-j  if  j€S^  and  variable  j  has  a  lower  bound; 

2 

j  if  j€Sk  and  variable  j  has  an  upper  bound; 

2 

-j  if  jeS^  and  variable  j  has  a  lower  bound. 

If  the  alternative  bound  has  been  considered,  the  entry 

in  appears  underlined.  In  backtracking,  the 

rightmost  nonunderlined  entry  is  underlined,  its  sign  is 

changed,  and  all  entries  to  its  right  are  erased.  If 

this  procedure  is  followed,  no  integer  combination  can 

be  overlooked  in  the  backtrack  operation.  At  Step  6, 

1  2 

the  backtracking  is  accompanied  by  updates  of  k,  H^,  H^, 
1  2 

S^,  and  .  The  vertex  counter  k  is  incremented  by  1, 

1  2 

the  bounds  of  and  are  updated  as  necessary,  and 

1  2 

the  indexes  of  restricted  variables,  S.  and  S,  ,  are 

k  k 

added  to  and  subtracted  from  depending  on  which 
variables  continue  to  be  restricted  at  the  new  vertex  of 
the  tree.  It  is  instructive  to  note  that  a  variable  may 
appear  in  P^  many  times.  For  example,  if  the  problem 
has  one  integer  variable  controlled  by  the  leader,  this 
variable  may  have  a  lower  bound  of  five  at  vertex  7  and 
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a  lower  bound  of  six  at  vertex  11.  Thus,  this 
variable's  index  would  appear  in  P  twice. 

At  Step  7,  the  algorithm  terminates.  If  F_  =  -oo, 
the  mixed  integer  BLPP  has  no  feasible  solution.  If  F_ * 
-oo,  a  solution  of  the  mixed  integer  BLPP  has  been  found. 
At  this  point,  the  optimality  of  the  solution  found  must 
be  addressed.  If  variables  controlled  by  the  leader  are 
restricted  to  integer  values,  the  basic  algorithm  finds 
the  optimal  solution  of  the  mixed  integer  BLPP.  This  is 
formally  stated  in  the  following  proposition. 

Proposition  6.2:  If  all  the  variables  controlled  by  the 
leader  are  restricted  to  integer  values,  then  under  the 
uniqueness  assumption  stated  in  Chapter  3,  the  algorithm 
finds  the  optimal  solution  of  (6.1). 

Proof :  Steps  3  and  5  ensure  all  possible  combinations 

of  x  are  implicitly  considered;  the  subproblem  solved  at 
Step  4  ensures  that  all  incumbent  solutions  are  in  the 
inducible  region  of  (6.1).  ■ 

If  the  variables  controlled  by  the  follower  are 
continuous,  then  the  basic  algorithm  will  find  the 
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optimal  solution  of  the  mixed  integer  BLPP  when 
additional  fathoming  rules  are  applied.  Proposition  6.3 
formally  states  this. 

Proposition  6.3:  If  all  the  variables  controlled  by  the 
follower  are  continuous,  then  under  the  uniqueness 
assumption  of  Chapter  3,  the  basic  algorithm  will  find 
the  optimal  solution  of  problem  (6.1)  if  fathoming  types 
2  (relaxed  solution  >  incumbent  solution  of  the  mixed 
integer  BLPP)  and  3  (solution  satisfies  the  integrality 
requirements)  are  applied. 

Proof :  Each  relaxed  subproblem  takes  the  form  of 

problem  (5.1).  By  Proposition  5.1,  the  algorithm  used 
to  solve  the  relaxed  subproblem  terminates  with  the 
optimal  solution  of  the  relaxed  subproblem.  Since  all 
variables  controlled  by  the  follower  are  continuous,  no 
restrictions  are  placed  on  them  in  the  subproblems 
created  by  the  basic  algorithm.  Hence,  all  solutions  of 
the  relaxed  subproblems  which  satisfy  the  integrality 
requirements  are  in  the  inducible  region  of  the  mixed 
integer  BLPP.  Using  fathoming  types  2  and  3  will  not 
prevent  the  basic  algorithm  from  uncovering  the  optimal 
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solution  of  the  mixed  integer  BLPP  since  placing  more 
restrictions  on  the  integer  valued  variables  controlled 
by  the  leader  and  continuing  to  branch  will  only  further 
restrict  the  leader's  decisions.  So,  each  solution 
which  satisfies  the  integrality  requirements  is  in  the 
inducible  region  and  applying  fathoming  types  2  and  3 
does  not  preclude  finding  the  optimal  solution.  Thus, 
the  optimal  solution  of  the  mixed  integer  BLPP  is 
uncovered .  ■ 

Unfortunately,  the  basic  algorithm  may  not  produce  an 
optimal  solution  when  at  least  one  of  the  variables 
controlled  by  the  leader  is  continuous  and  one  of  the 
variables  controlled  by  the  follower  is  integer.  The 
following  example  illustrates  this. 

Example  6.4 

Max  F(x,y)  =  x  +  lOy  where  y  solves 

x 

Max  f (x,y )  =  -y 

y 

subject  to  -25x  +  20y  <  30 
x  +  2y  <  10 
2x  -  y  <  15 


y  integer 


Example  6.4  is  identical  to  Example  6.1  except  that  the 
variable  controlled  by  the  leader  is  continuous.  The 
optimal  solution  of  Example  6.1  is  (x*,y*)  =  (2,2)  with 
F  =  22.  The  optimal  solution  of  Example  6.4  is  (x*,y*) 

=  (2.5-z  ,2)  where  £>0  is  arbitrarily  small.  The  value 
of  the  leader's  objective  function  at  this  point  is  F  = 
22.5-s.  If  the  leader  chooses  x  =  2.5,  the  follower's 
decision  is  y  *  1,  and  F  =  12.5.  Theorem  3.2  says  that 
the  solution  of  the  linear  BLPP  is  at  an  extreme  point 
of  the  BLPP  constraint  region.  The  relaxed  problem 
solved  at  Step  2  is  a  linear  BLPP.  Unfortunately,  the 
bounds  placed  on  y  at  Steps  3  and  5  never  create  a 
linear  BLPP  which  has  an  extreme  point  at  the  optimal 
value  of  x  in  Example  6.4.  The  best  feasible  solution 
found  by  the  algorithm  is  (x,y)  =  (2,2).  This  solution 
is  found  when  the  constraint  y  >  4  is  added.  If  y  >  4, 
the  solution  of  the  relaxed  BLPP  is  (x,y)  =  (2,4).  When 
x  is  fixed  at  2  at  Step  4  and  the  follower's  problem  is 
solved,  the  solution  is  (x,y)  =  (2,2).  The  following 
proposition  formally  states  the  fact  that  the  algorithm 


does  not  guarantee  an  optimal  solution  of  (6.1). 


Proposition  6.4:  If,  in  (6.1),  one  or  more  of  the 
variables  controlled  by  the  leader  is  real  valued  and 
one  or  more  of  the  variables  controlled  by  follower  is 
integer  valued,  the  algorithm  finds  a  feasible  but  not 
necessarily  optimal  solution  of  (6.1). 

6.6.2  Development  of  Heuristics 

As  shown  in  Example  6.4,  a  complete  enumeration  of 
the  integer  variables  of  (6.1)  does  not  guarantee 
discovery  of  an  optimal  solution.  Thus,  the  algorithm 
is  a  heuristic  which,  as  shown  in  Proposition  6.4,  finds 
a  solution  in  the  inducible  region  of  (6.1). 
Unfortunately,  for  problems  with  10  or  more  integer 
variables,  the  algorithm  may  require  almost  complete 
enumeration  of  the  integer  valued  variables  before 
terminating  with  a  solution  in  the  inducible  region  of 
(6.1).  The  efficiency  of  the  algorithm  can  be  improved 
by  including  an  additional  bound  and  fathoming  rules. 
These  changes  weaken  the  algorithm  and  make  it  less 
likely  that  the  true  optimum  will  be  found.  The 
additional  bound  and  fathoming  rules  represent  a 


tradeoff  between  accuracy  and  computational  effort.  At 
Step  2,  a  bound  on  the  solution  of  the  relaxed  problem 
is  considered,  and  at  Step  4,  three  different  fathoming 
rules  can  be  included.  A  combination  of  these  changes 
yields  eight  different  algorithms  which  must  be 
explored. 

A  bound  which  can  be  easily  incorporated  in  the 
algorithm  is  based  on  the  solution  of  the  relaxed  BLPP 
found  at  Step  2.  When  this  solution  gives  a  value  for 
the  leader's  objective  function  which  is  less  than  the 
incumbent  solution,  fathoming  is  accomplished.  This  is 
analogous  to  fathoming  type  2  in  Section  6.2.  The 
change  is  shown  in  Step  2a. 

Step  2a:  (Relaxed  Solution)  Attempt  to  solve  the 

relaxed  BLPP  (6.2).  If  infeasible,  go  to  Step 

lr  1c 

6.  If  successful,  label  the  solution  (x  )• 
Compute  Ftx^,^)  •  If  F(xk,  Yk)<F_,  go  to  Step 
6;  otherwise  go  to  Step  3. 

Several  fathoming  rules  can  be  applied  at  Step  4.  Three 
rules  are  selected  for  study  and  are  shown  below  in 
Steps  4a,  4b,  and  4c. 


,  i  .  i>.  A • j 


Step  4a:  (Feasible  Point)  Fix  x  at  x  and  solve  the 

Ir  **  t 

follower's  problem  to  obtain  (x  ,y  ).  Compute 
F(xk,yk).  If  F<F(xk,yk),  put  F«-F(xk,yk)  and 
go  to  Step  5;  otherwise  go  to  Step  6. 


—  lr 

Step  4b:  (Feasible  Point)  Fix  x  at  x  and  solve  the 

k  ^  k 

follower's  problem  to  obtain  (x  ,y  ).  Compute 


F(xk,yk)  and  put  F=max  [  F_,  F  ( x* , yk)  ]  .  If  yk=£ 
go  to  Step  6;  otherwise  go  to  Step  5. 


k  *k. 


*k  k 


Step  4c:  (Feasible  Point)  Fix  x  at  x  and  solve  the 

k  *  k 

follower's  problem  to  obtain  (x  ,y  ).  Compute 
F(xkfyk)  and  put  F=max[F_,F(xk,yk)  ]  .  Go  to 

/v  /v 

Step  6. 


Step  4a  allows  the  algorithm  to  go  to  Step  6  and 
backtrack  when  the  solution  at  the  current  vertex  of  the 
branch  and  bound  tree  satisfies  the  integer  requirements 
and  the  point  in  the  inducible  region  derived  from  this 
solution  does  not  have  a  value  greater  than  that  of  the 
incumbent  solution  of  (6.1).  Step  4b  sends  the 
algorithm  to  Step  6  when  the  solution  at  the  current 


ITBTlKWrVflWWI*] 


132 

vertex  satisfies  the  integer  requirements  of  (6.1)  and 
is  in  the  inducible  region  of  the  mixed  integer  BLPP. 
Step  4c  allows  the  algorithm  to  backtrack  at  Step  6  when 
the  integer  requirements  of  (6.1)  are  satisfied.  Using 
various  combinations  of  the  above  steps,  seven 
additional  algorithms  which  find  feasible  solutions  of 
(6.1)  are  formed.  The  eight  algorithms  are  shown  in 
Table  6.1. 

TABLE  6.1:  THE  EIGHT  ALGORITHMS 


Algorithm  Description 


1 

The  basic 

algorithm, 

2 

Algorithm 

1 

with 

Step 

4 

replaced 

by 

Step 

4a, 

3 

Algorithm 

1 

with 

Step 

4 

replaced 

by 

Step 

4b, 

4 

Algorithm 

1 

with 

Step 

4 

replaced 

by 

Step 

4C, 

5 

Algorithm 

1 

with 

Step 

2 

replaced 

by 

Step 

2a, 

6 

Algorithm 

5 

with 

Step 

4 

replaced 

by 

Step 

4a, 

7 

Algorithm 

5 

with 

Step 

4 

replaced 

by 

Step 

4b , 

8 

Algorithm 

5 

with 

Step 

4 

replaced 

by 

Step 

4C  . 

The  next  section  presents  a  demonstration  of  the 
algorithms . 

6.6.3  Demonstration 

Example  6.2  is  used  to  demonstrate  how  the 
algorithms  work.  The  discussion  focuses  on  Algorithm  1 
and  shows  where  the  other  algorithms  would  backtrack. 


I 


1 
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Example  6.2  is 
Example  6 . 2 

Max  F(x,y)  =  -x  -2y  where  y  solves 


x 

Max  f(x,y)  =  y 

y 

subject  to  -x  +  2 . 5y  <  3.75 
x  +  2 . 5y  >  3.75 
2.5x  +  y  <  8.75 
x,  y  >  0 
x,  y  integer. 

A  graph  of  this  example  is  shown  in  Figure  6.2.  Because 

the  variable  controlled  by  the  leader  is  integer, 

Algorithm  1  finds  the  optimal  solution  of  this  problem. 

12  1 

To  shorten  the  discussion,  the  updates  of  H^,  Hfc,  Sfc, 

2 

and  are  not  given.  Rather,  the  bounds  on  x  and  y  and 

the  path  vector  P^  at  each  vertex  are  given.  For 

convenience,  x  and  y  are  labeled  1  and  2,  respectively, 

in  the  path  vector.  The  branch  and  bound  tree  created 

in  solving  Example  6.2  has  18  vertices  and  is  shown  in 

Figure  6.6.  At  vertex  zero.  Algorithm  1  solves  the  high 

point  problem.  At  Step  2,  the  solution  of  the  relaxed 
0  0 


BLPP  is  (x  ,y  )  =  (0,1.5)  with  F  =  -3, 


1 


I 


At  Step  3,  the 


algorithm  places  an  upper  bound  of  y  <  1.  Thus,  at 

vertex  1,  0<x<co,  0<y<l  and  P1  =  {2}.  Returning 

to  Step  1,  the  high  point  solution  does  not  provide  a 

bound,  so  the  algorithm  solves  the  relaxed  BLPP  at  Step 

2  with  (x1,^1)  =  (1.25,1.0)  and  F  =  -3.25.  At  Step  3,  x 

is  the  branching  variable,  and  the  bounds  are  0  <  x  <  1 

and  0  <  y  <  1  with  P2  =  (2,1).  The  resulting  BLPP  is 

infeasible  at  Step  2,  so  the  algorithm  goes  to  Step  6 

and  backtracks .  The  new  bounds  are  0  <  y  <  1  and 

2  <  x  <  (»  with  P3  =  (2,-lJ.  Returning  to  Step  1,  the 

high  point  problem  is  again  solved.  At  Step  2,  the 

solution  of  the  relaxed  BLPP  is  F  =  -3.69  with  (x3,y3)  = 

(3.45,0.12).  At  Step  3,  an  upper  bound  of  3  is  placed 

on  x,  and  the  bounds  on  the  variables  are  2  <  x  <  3  and 

0  <  y  <  1  with  P^  =  (2,-l_,  1).  Going  to  Step  1, 

backtracking  cannot  be  done,  so  at  Step  2,  the  relaxed 

4  4 

BLPP ' s  solution  at  vertex  4  is  (x  ,  y  )  =  (2,1)  with 

F  =  -4 .  At  Step  3,  the  integer  requirements  are 

satisfied,  so  the  algorithm  proceeds  to  Step  4.  The 

variable  x  is  fixed  at  2,  and  the  follower's  problem  is 

4  "4 

solved  to  get  the  point  (x  ,y  )  =  (2,2)  with  F  =  -6. 

The  incumbent  is  updated,  so  F_=  -6.  At  Step  5,  the 
variable  x  is  at  the  top  of  the  list,  so  it  is  the 


branching  variable.  A  new  upper  bound  is  placed  on  x, 

so  the  bounds  on  the  variables  are  2  <  x  <  2  and 

0  <  y  <  1  with  Pg  =  (2,-l_,  1,1}.  Returning  to  Step  1, 

the  current  vertex  cannot  be  fathomed.  At  Step  2,  the 

solution  is  (x5,y5)  =  (2,1)  with  F  =  -4.  At  Step  3,  the 

integer  requirement  is  satisfied,  so  the  algorithm  drops 

to  Step  4.  Fixing  x  at  2 ,  the  solution  of  the 

5  *  5 

follower's  problem  is  y=  2,  so  (x  ,y  )  =  (2,2)  and 

F  =  -6.  This  is  not  an  improvement  on  the  incumbent 

solution,  so  updating  is  not  done.  At  Step  5 ,  y  is  the 

only  variable  on  which  branching  can  be  done.  An  upper 

bound  of  0  is  placed  on  y,  so  the  bounds  on  the 

variables  are  2  <  x  <  2  and  0  <  y  <  0.  P_  =  (2,-l,l, 

o 

1,2),  and  going  to  Step  1,  the  algorithm  cannot 

backtrack.  At  Step  2,  the  relaxed  BLPP  is  infeasible, 

so  the  algorithm  proceeds  to  Step  6,  backtracks  with 

P?  =  { 2 , -l_j  1 , 1 , -2_)  as  a  lower  bound  of  1  is  placed  on  y, 

and  returns  to  Step  1 .  The  bounds  on  the  variables  are 

now  2  <  x  <  2  and  1  <  y  <  1 .  At  vertex  7 ,  Step  1  does 

not  allow  backtracking,  and  the  solution  at  Step  2  is 
7  7 

(x  >X  )  =  (2,1).  Because  the  solution  satisfies  the 
integer  requirements,  Step  3  sends  the  algorithm  to  Step 


F  =  -6 .  The  incumbent  solution  cannot  be  updated,  and 

at  Step  5,  no  variable  can  be  branched  on,  so  the 

algorithm  goes  to  Step  6  where  backtracking  is  done.  A 

new  lower  bound  is  placed  on  x,  so  the  bounds  on  the 

variables  are  3  <  x  <  3  and  0  <  y  <  1  with  PQ  =  {2,-1, 

1,-1}.  Returning  to  Step  1,  vertex  8  cannot  be 

8  8 

fathomed.  At  Step  2,  the  solution  is  (x  ,y  )  =  (3,1) 

with  F  =  -5.  At  Step  3,  the  integer  requirement  is 

satisfied,  so  the  algorithm  proceeds  to  Step  4.  Fixing 

x  at  3,  the  solution  of  the  follower's  problem  is  y  =  1, 
8  ~  8 

so  (x  , y  )  =  (3,1)  and  F  *  -5.  This  is  an  improvement 
on  the  incumbent  solution,  and  updating  gives  F_ =  -5. 

At  Step  5,  y  is  the  only  variable  on  which  branching  can 
be  done.  An  upper  bound  of  0  is  placed  on  y,  so  the 
bounds  on  the  variables  are  3  <  x  <  3  and  0  <  y  <  0. 

Pg  =  (2,-l_,l,-l_,  2}  ,  and  going  to  Step  1,  the  algorithm 
cannot  backtrack.  At  Step  2,  the  relaxed  BLPP  at  vertex 
9  is  infeasible,  so  backtracking  is  done.  A  lower  bound 
of  1  is  placed  on  y,  and  P1Q  =  { 2  , -1_,  1 , -1_, -2J  .  Steps  2, 
3,  and  4  are  the  same  as  at  vertex  8,  and  the  algorithm 
reaches  Step  5.  Here,  no  variable  can  be  branched  on, 
so  the  algorithm  goes  to  Step  6.  Backtracking  is  done, 
and  P11  =  { 2  ,  — 1_,  — 1_)  .  The  bounds  on  the  variables  are 


4  <  x  <  oo  and  0  <  y  <  1.  The  algorithm  then  continues 
at  Step  1.  Algorithm  1  continues  on  to  termination  and 
creates  a  branch  and  bound  tree  with  18  vertices.  The 
optimal  solution  is  (x*,y*)  =  (3,1)  with  F  =  -5  and  was 
discovered  at  vertex  8 . 

Algorithms  2,  3,  5,  6,  and  7  also  found  the  optimal 
solution  of  Example  6.2.  Because  Algorithms  4  and  8 
backtrack  when  they  find  an  integer  solution,  they  did 
not  find  the  optimal  solution.  The  solution  in  the 
inducible  region  Algorithms  4  and  8  found  was  (x,y)  = 
(2,2)  with  F  =  -6,  and  it  was  uncovered  at  vertex  4. 

The  information  on  the  trees  produced  by  Algorithms  1 
through  8  is  presented  in  Table  6.2.  The  vertices  which 
appear  in  the  branch  and  bound  trees  created  by  the 
eight  algorithms  are  listed  in  the  table.  The  vertices 
listed  correspond  to  those  shown  in  Figure  6.6. 
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TABLE  6.2:  BRANCH  AND  BOUND  TREE  DATA  FOR  EXAMPLE  6.2 
No .  of 

Algor  Vertices  Vertices  in  Branch  and  Bound  Tree 


1 

2 

3 

4 

5 

6 

7 

8 


18  1-2-3-4-5-6-7-8-9-10-11-12-13-14-15-16-17-18 

16  1-2-3-4-5-6-7-8-9-10-11-12-13-14-15-18 

14  1-2-3-4-5-6-7-8-11-12-13-14-15-18 

10  1-2-3-4-11-12-13-14-15-18 

12  1-2-3-4-5-6-7-8-9-10-11-12 

12  1-2-3-4-5-6-7-8-9-10-11-12 

10  1-2-3-4-5-6-7-8-11-12 

8  1-2-3-4-11-12-13-14 


The  tree  for  Algorithm  2  does  not  contain  vertices  16 
and  17.  These  vertices  are  not  explored  because  at 
vertex  15,  an  integer  solution  of  the  relaxed  BLPP  is 
found  which  does  not  provide  an  improvement  over  the 
incumbent  solution,  so  the  algorithm  backtracks.  The 
tree  for  Algorithm  3  does  not  contain  vertices  9,  10, 

16,  and  17.  This  happens  because  at  vertices  8  and  15, 
solutions  of  the  relaxed  BLPP  are  integer  and  in  the 
inducible  region  of  Example  6.2.  This  also  explains  why 
vertices  9  and  10  are  not  explored  by  Algorithm  7. 
Algorithm  4  does  not  explore  vertices  5,  6,  7,  8,  9,  10, 
16,  and  17.  The  reason  for  this  is  that  at  vertices  4 
and  15,  the  relaxed  BLPP  has  an  integer  solution.  This 
also  explains  why  Algorithm  8  does  not  inspect  vertices 


5  through  10.  Algorithm  5  does  not  include  vertices  13 
through  18  in  its  branch  and  bound  tree.  This  is 
because  the  solution  of  the  relaxed  BLPP  at  vertex  12  is 


less  than  the  incumbent  solution.  For  this  reason, 
Algorithms  6  and  7  do  not  explore  vertices  13  to  18. 
Algorithm  8  does  not  inspect  vertices  15  to  18.  This 
happens  because  the  solution  of  the  relaxed  BLPP  at 
vertex  14  is  less  than  the  current  incumbent  solution. 

6 . 7  Computational  Results 

The  results  presented  in  this  section  show  the 
outcomes  of  experiments  used  to  determine  the  method  for 
selecting  the  branching  variable  at  Steps  3  and  5  of  the 
algorithm.  Ten  sample  problems  are  randomly  generated 
and  used  to  test  various  rules  for  selecting  the 
branching  variable  at  Steps  3  and  5.  This  section  also 
presents  the  results  achieved  using  the  eight  algorithms 
to  find  feasible  solutions  of  randomly  generated  mixed 
integer  BLPPs . 

The  problems  used  to  test  the  various  rules  at 

Steps  3  and  5  and  the  eight  algorithms  were  created 

using  the  same  random  problem  generator.  In  each 

randomly  generated  problem,  the  coefficients  of  the  A1, 

2  1  2 

A  ,  B  ,  and  B  matrices  range  between  -15  and  45  with 
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approximately  25  percent  of  the  entries  being  negative. 
The  density  of  each  matrix  is  between  0.4  and  0.5  and 
averages  0.47.  The  coefficients  of  the  two  objective 
functions  vary  between  -25  and  25  with  approximately  50 
percent  less  than  zero.  The  number  of  constraints  in 
each  problem  is  set  at  0.4  times  the  total  number  of 
variables,  and  the  right-hand  side  values  range  between 
0  and  50.  The  signs  of  the  constraints  had  a  0.7 
probability  of  being  <  and  a  0.3  probablity  of  being  >. 
The  number  of  integer  variables  controlled  by  the  leader 
and  follower  are  set,  and  the  variables  flagged  as 
integer  are  randomly  selected. 

The  linear  programming  subroutine  library  XMP 
(Marsten  1981)  is  used  to  solve  the  linear  problems 
encountered  at  Steps  1,  2,  and  4  of  the  algorithms.  In 
creating  the  bounds  on  the  integer  variables, 
constraints  are  not  added  to  the  original  constraint 
set.  The  XMP  subroutines  can  be  used  to  solve  a  bounded 
variable  linear  program.  This  feature  permits  the  use 
of  upper  and  lower  bounds  on  the  variables.  In  the  code 
which  computerizes  the  algorithms,  the  bounds  on  each 
variable  are  maintained  and  adjusted  as  the  algorithms 
place  and  reset  the  bounds  on  each  variable.  These 
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bounds  are  then  included  in  the  problem  solved  by  the 
XMP  subroutines. 

At  Step  4,  the  algorithm  solves  a  mixed  integer 
programming  problem.  The  variables  controlled  by  the 
leader  are  fixed,  and  the  follower's  problem  (6.6)  is 
solved.  Utilizing  XMP,  the  basis  associated  with  the 
current  point  is  used  as  the  starting  basis.  The 
constraints  of  the  problem  do  not  have  to  be  altered  in 
this  approach.  Since  the  variables  controlled  by  the 
leader  are  fixed,  the  XMP  subroutines  will  work  with  the 
constraints  in  their  original  form.  The  coefficients  of 
the  variables  in  the  objective  function  are  given  the 
values  they  have  in  the  follower's  objective  function. 
The  only  bounds  on  the  variables  controlled  by  the 
follower  are  those  of  the  mixed  integer  BLPP  (6.1).  All 
restrictions  on  the  slack  variables  and  Kuhn-Tucker 
multipliers  are  relaxed.  Once  these  changes  have  been 
made,  a  branch  and  bound  approach  is  used  to  solve  the 
follower's  problem.  The  XMP  subroutines  are  used  to  do 
this,  and  bounds  on  the  integer  valued  variables 
controlled  by  the  follower  are  added  by  using  the  upper 
and  lower  variable  bounds  maintained  in  the  XMP 


subroutines . 


6.7.1  Determining  a  Branching  Variable  Selection  Rule 
At  Step  3,  11  different  rules  for  selecting  the 

integer  variable  on  which  to  branch  are  explored.  The 

rules  are  listed  below. 

1.  Branch  on  the  integer  variable  with  the  largest 
fractional  part. 

2.  Branch  on  the  integer  variable  with  the  smallest 
nonzero  fractional  part. 

3.  Branch  on  the  integer  variable  which  is  not  integer 
valued  and  has  the  largest  product  for  the  variable 
value  times  its  contribution  to  the  leader's 
objective  function. 

4.  Branch  on  the  integer  variable  which  is  not  integer 
valued  and  has  the  smallest  product  for  the 
variable  value  times  its  contribution  to  the 
leader's  objective  function. 

5.  Branch  on  the  integer  variable  which  is  not  integer 
valued  and  has  the  largest  value. 

6.  Branch  on  the  integer  variable  which  is  not  integer 


valued  and  has  the  smallest  value. 


7.  Branch  on  the  leader's  variables  before  the 
follower's  variables  using  rule  1  to  choose  the 
branching  variable. 

8.  Branch  on  the  follower's  variables  before  the 
leader's  variables  using  rule  1  to  choose  the 
branching  variable. 

9.  Branch  on  the  integer  variable  which  is  not  integer 
valued  and  has  the  largest  coefficient  in  the 
leader's  objective  function. 

10.  Branch  on  the  integer  variable  which  is  not  integer 
valued  and  has  the  smallest  coefficient  in  the 
leader's  objective  function. 

11.  Branch  on  the  integer  variable  whose  fractional 
part  is  closest  to  0.5. 

These  rules  are  tested  using  Algorithm  7  because  the  CPU 
time  it  requires  to  solve  the  test  problems  is,  in 
general,  reasonable  for  the  test  problems  used  to 
evaluate  the  above  rules.  The  10  test  problems  are  of 
various  size  as  shown  in  Table  6.3. 


TABLE  6.3:  TEST  PROBLEM  SIZE 


Prob. 

No. 

No .  of 
Variables 
(n‘  +n2  ) 

Follower 
Variables 
(n*  ) 

Integer 
Leader 
Variables 
(n*  *  ) 

Integer 
Follower 
Variables 
(n**  ) 

1 

12 

5 

4 

1 

2 

15 

5 

5 

0 

3 

20 

10 

4 

3 

4 

25 

10 

5 

5 

5 

25 

10 

6 

4 

6 

25 

10 

4 

6 

7 

25 

10 

7 

3 

8 

25 

10 

7 

3 

9 

25 

10 

10 

0 

10 

35 

15 

4 

5 

In  testing  the  rules,  a  300  second  CPU  time  limit  was 
used,  and  if  this  limit  was  exceeded,  the  algorithm  was 
halted.  Results  were  achieved  using  an  IBM  3081-D 
computer.  Rule  1  provided  the  best  results.  The 
average  CPU  time  required  to  solve  the  10  test  problems 
when  rule  1  was  used  at  Step  3  of  Algorithm  7  was  less 
than  the  average  CPU  time  required  when  the  other  rules 
were  applied.  The  results  are  interesting  and  are 
presented  in  Table  6.4.  Table  6.4  also  shows  the 
results  achieved  in  testing  the  rules  at  Step  5. 
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TABLE  6.4:  CPU  TIME  (SECS)  FOR  RULES  AT  STEPS  3  AND  5 


Problem 


Step 

Rule 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

3 

1 

3 

1 

2 

72 

6 

16 

142 

5 

23 

67 

3 

2 

4 

2 

2 

109 

9 

20 

188 

7 

31 

117 

3 

3 

4 

2 

3 

127 

7 

22 

t 

8 

34 

t 

3 

4 

4 

1 

1 

107 

8 

17 

166 

7 

27 

95 

3 

5 

2 

2 

1 

77 

7 

19 

164 

6 

29 

106 

3 

6 

4 

2 

2 

108 

6 

17 

155 

8 

27 

77 

3 

7 

3 

1 

2 

101 

7 

22 

173 

7 

26 

106 

3 

8 

3 

2 

2 

80 

6 

18 

155 

6 

28 

110 

3 

9 

3 

1 

3 

124 

8 

24 

182 

8 

25 

89 

3 

10 

2 

2 

1 

103 

7 

19 

151 

7 

30 

94 

3 

11 

4 

2 

3 

137 

9 

21 

t 

7 

33 

» 

5 

1 

3 

1 

2 

63 

8 

27 

162 

5 

19 

87 

5 

2 

3 

1 

2 

77 

9 

15 

178 

6 

21 

96 

5 

3 

3 

1 

2 

72 

6 

16 

142 

5 

23 

67 

♦CPU  time  exceeded  300  seconds 

Averages  could  not  be  computed  for  rules  3  and  11. 
While  attempting  to  solve  problems  7  and  10,  the 
algorithm  was  halted  because  the  CPU  time  exceeded  300 
seconds.  For  problems  1,  2,  and  3,  the  CPU  time  varied 
among  the  various  rules  by  no  more  than  0.8  seconds. 

The  longest  required  CPU  time  for  these  three  problems 
was  4.2  seconds.  Rule  6  was  the  second  best  rule.  Its 
average  CPU  time  exceeded  rule  l's  by  7  seconds. 

Ordering  the  remaining  rules  from  best  to  worst  gives  8, 
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5,  10,  4,  7,  9,  and  2.  Three  problems  really  affected 
the  outcome  of  the  averaging.  They  are  problems  4,  7, 
and  10.  The  greatest  difference  observed  is  51  seconds. 
This  occurred  on  problem  4  between  rules  1  and  9.  Once 
rule  1  was  selected  as  the  rule  for  choosing  the 
branching  variable,  the  direction  of  the  branching  had 
to  be  determined.  Three  rules  were  considered.  The 
rules  are  always  placing  a  lower  bound  on  the  variable, 
always  placing  an  upper  bound  on  the  variable,  or 
letting  the  sign  of  the  variable's  coefficient  in  the 
leader's  objective  function  determine  whether  a  lower  or 
upper  bound  is  placed  on  the  variable.  For  seven  of  the 
10  test  problems,  always  placing  an  upper  bound  on  the 
variable  required  between  2  and  6  additional  seconds  CPU 
time,  and  this  represents  a  15  percent  increase  in  the 
average  CPU  time  for  these  seven  problems.  The  two 
other  rules'  CPU  times  are  much  closer.  On  three  of  the 
problems,  the  two  bounding  rules  required  the  same 
amount  of  CPU  time.  On  three  other  problems,  always 
placing  a  lower  bound  on  the  variable  required  less  CPU 
time.  The  improvement  over  basing  the  bound  on  the 
variable's  coefficient  in  the  leader's  objective 
function  is  0.5  to  1.0  seconds  which  is  an  eight  percent 


difference.  On  the  four  remaining  problems,  basing  the 
bound  on  the  variable's  coefficient  in  the  leader's 


objective  function  provided  the  best  results.  The  range 
of  the  improvement  is  0.5  to  3.0  seconds  or  a  12  percent 
improvement .  These  improvements  are  achieved  on  the 
more  difficult  problems  which  are  problems  4,  7,  and  10. 
Because  of  this,  the  bound  placed  on  the  variable 
selected  for  branching  is  based  on  the  variable's 
coefficient  in  the  leader's  objective  function.  If  the 
coefficient  is  zero  or  positive,  a  lower  bound  is  placed 
on  the  variable,  and  if  the  coefficient  is  negative,  an 
upper  bound  is  placed  on  the  variable. 

At  Step  5,  devising  a  rule  for  selecting  a 
branching  variable  when  all  the  integer  variables  have 
integer  values  in  the  current  solution  is  difficult. 
Three  rules  for  doing  this  are  tested.  The  rules  are 

1.  Branch  on  a  variable  whose  upper  and  lower  bounds 
are  not  equal  and  whose  level  in  the  tree  along  the 
current  path  is  nearest  vertex  zero. 

2.  Branch  on  a  variable  whose  upper  and  lower  bounds 
are  not  equal  and  whose  level  in  the  tree  along  the 
current  path  is  farthest  from  vertex  zero. 
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3.  Branch  on  a  variable  whose  upper  and  lower  bounds 
are  not  equal  and  whose  position  in  a  list  3s 
nearest  the  top.  When  a  variable  is  selected  in 
this  manner,  the  variable  is  placed  at  the  bottom  of 
the  list.  The  list  is  initialized  with  the 
variables  ordered  according  to  their  coefficient  in 
the  leader's  objective  function.  The  order  is  from 
largest  to  smallest. 

For  each  rule,  the  direction  of  bounding  is  determined 
by  the  selected  variable's  value  in  the  leader's 
objective  function.  For  each  rule,  if  the  variable's 
coefficient  in  the  leader's  objective  function  is 
negative,  an  upper  bound  is  placed  on  the  variable,  and 
if  the  coefficient  is  positive,  a  lower  bound  is  placed 
on  the  variable.  The  results,  which  are  presented  in 
Table  6.4,  show  Rules  1  and  2  require  more  CPU  time  than 
Rule  3.  The  poor  results  of  Rules  1  and  2  occurred  when 
the  same  variable  was  branched  on  many  times  before  the 
algorithm  backtracked.  For  the  10  problems  which  are 
solved  using  the  three  rules,  the  average  CPU  time  using 
Rule  3  is  four  seconds  or  10  percent  less  than  the 
average  time  achieved  by  ttuie  1  and  seven  seconds  or  18 


percent  less  than  the  average  achieved  by  Rule  2.  Thus, 
Rule  3  is  selected  as  the  branching  rule  at  Step  5. 

6.7.2  Testing  the  Eight  Algorithms 

To  test  the  eight  algorithms,  50  problems  are 
randomly  generated  and  solved  using  an  IBM  3084-DQX 
computer.  Ten  classes  of  problems  with  five  problems  in 
each  class  are  generated.  The  information  on  these 
problems  is  shown  in  Table  6.5. 


TABLE  6.5:  TEST  PROBLEM  SIZE 


Class 

No. 

No .  of 
Variables 
( n*  +n*  ) 

Follower 
Variables 
(n*  ) 

Integer 
Leader 
Variables 
(n‘*  ) 

Integer 
Follower 
Variables 
(n*  *  ) 

1 

15 

5 

2 

3 

2 

15 

5 

3 

4 

3 

20 

10 

5 

5 

4 

25 

10 

5 

5 

5 

30 

15 

5 

5 

6 

30 

15 

7 

8 

7 

35 

15 

5 

5 

8 

35 

15 

8 

9 

9 

40 

20 

5 

5 

10 

40 

20 

10 

10 

Tables  6.6,  6.7, 

and  6.8  summarize  the 

computational  results  achieved  using  the  eight 
algorithms.  Results  are  shown  as  averages  for  each 
problem  class.  Table  6.6  shows  the  average  CPU  time 


required  by  each  algorithm  to  reach  termination.  Table 


6.7  displays  the  average  number  of  vertices  needed  by 
each  algorithm  to  reach  termination.  Table  6.8  shows 
the  average  number  of  vertices  required  by  each 
algorithm  to  find  the  best  solution  in  the  inducible 
region  an  algorithm  can  uncover. 


TABLE  6 

.6: 

AVERAGE 

CPU 

TIME  FOR 

ALGORITHMS 

Problem 

Alg. 

Alg 

.  Alg . 

Alg 

.  Alg. 

Alg. 

Alg. 

Alg 

Class 

1 

2 

3 

4 

5 

6 

7 

8 

1 

5 

1 

3 

1 

3 

1 

3 

1 

2 

210 

1 

1 

1 

1 

1 

1 

1 

3 

186 

27 

105 

17 

49 

12 

35 

9 

4 

73 

5 

5 

4 

6 

5 

5 

4 

5 

678 

77 

837 

70 

683 

57 

730 

50 

6 

244 

46 

113 

41 

99 

36 

97 

32 

7 

170 

42 

33 

28 

41 

38 

28 

24 

8 

634 

178 

422 

175 

89 

72 

84 

66 

9 

366 

103 

235 

81 

ii8 

78 

107 

59 

10 

730 

272 

454 

311 

123 

123 

118 

118 

v  >■,  .0  /itv. 


TABLE  6.7:  AVERAGE  NUMBER  OF  VERTICES  IN  THE  BRANCH  AND 
BOUND  TREE 


Problem 

Class 

Alg 

1 

.  Alg . 

2 

Alg. 

3 

Alg . 
4 

Alg. 

5 

Alg . 
6 

Alg . 

7 

Alg . 

8 

1 

86 

21 

56 

18 

51 

21 

49 

18 

2 

250 

12 

10 

8 

14 

12 

10 

8 

3 

541 

60 

313 

54 

169 

32 

166 

26 

4 

243 

11 

11 

8 

12 

10 

10 

7 

5 

483 

49 

415 

42 

343 

26 

362 

20 

6 

380 

40 

239 

35 

225 

27 

:23 

24 

7 

90 

15 

15 

11 

13 

11 

9 

6 

8 

366 

115 

249 

117 

51 

40 

47 

37 

9 

136 

30 

84 

25 

41 

20 

38 

15 

10 

128 

42 

70 

40 

30 

30 

27 

27 

TABLE  6. 

.8: 

AVERAGE 

FEASIBLE 

NUMBER  OF  VERTICES 
:  SOLUTION 

TO  FIND  BEST 

Problem 

Alg 

.  Alg. 

Alg. 

Alg. 

Alg. 

Alg . 

Alg. 

Alg. 

Class 

1 

2 

3 

4 

5 

6 

7 

8 

1 

60 

19 

56 

18 

49 

19 

48 

18 

2 

44 

10 

10 

8 

12 

10 

10 

8 

3 

212 

33 

201 

28 

148 

27 

146 

23 

4 

10 

7 

6 

6 

7 

7 

6 

6 

5 

78 

26 

60 

22 

62 

20 

57 

16 

6 

216 

23 

216 

21 

209 

22 

208 

21 

7 

59 

8 

8 

5 

10 

8 

8 

5 

8 

94 

90 

36 

96 

46 

34 

44 

34 

9 

107 

26 

74 

23 

38 

17 

37 

14 

10 

36 

20 

27 

20 

20 

20 

20 

20 

In  collecting  the  above  results,  several  observations 
should  be  highlighted.  Algorithm  1  had  a  tendency  to 
get  into  a  branching  loop.  That  is,  one  particular 
variable  would  be  selected  for  branching,  and  the 
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algorithm  would  be  unable  to  find  a  vertex  where  it 
could  backtrack.  Since  branching  is  done  on  variables 
which  have  integer  values,  a  variable  would  be  selected 
for  branching,  and  as  bounds  were  placed  on  the 
variable,  the  resulting  subproblems  would  continue  to  be 
feasible.  Because  of  the  weak  bound  used  to  test  a 
solution.  Algorithm  1  is  unable  to  backtrack,  so  many 
vertices  can  be  added  to  the  branch  and  bound  tree 
before  backtracking  is  accomplished.  As  a  result  of 
this,  a  restriction  is  placed  on  the  number  of  vertices 
in  the  branch  and  bound  tree.  If  the  number  of  vertices 
reaches  995,  the  algorithm  is  terminated,  and  the 
incumbent  solution  is  declared  the  best  solution  in  the 
inducible  region  the  algorithm  could  find.  Algorithm  1 
reaches  the  vertex  limit  on  eight  problems.  Algorithm  3 
exceeds  the  allowed  number  of  vertices  three  times. 
Algorithms  5  and  7  each  surpass  the  vertex  limit  twice. 
Algorithms  2,  4,  6,  and  8  never  exceed  the  vertex  limit. 
Classes  1,  7,  9,  and  10  have  no  problems  which  caused  an 
algorithm  to  surpass  the  vertex  limit. 

On  11  of  the  50  problems,  the  algorithms  did  not 
reach  the  same  feasible  solution.  On  4  of  the  11 
disagreements.  Algorithm  1  did  not  provide  the  best 


feasible  solution.  In  each  case,  the  algorithm 
terminated  because  it  exceeded  the  vertex  limit. 


Algorithms  3,  5,  and  7  each  terminated  once  at  the 
vertex  limit  without  reaching  a  feasible  solution  as 
good  as  that  found  by  one  of  the  other  algorithms.  On 
three  of  the  problems  which  the  algorithms  did  not  reach 
the  same  solution,  vertex  limit  violation  is  the 
explanation.  For  the  fourth  problem,  the  best  feasible 
solution  was  found  by  Algorithm  3  alone.  On  this 
particular  problem.  Algorithm  3  terminated  because  it 
had  reached  the  vertex  limit.  Algorithms  1,  5,  and  7 
terminated  at  the  vertex  limit  with  solutions  less  than 
the  one  found  by  Algorithm  3.  The  other  algorithms 
terminated  normally  without  achieving  the  same  solution 
as  Algorithm  3. 

For  the  other  seven  disagreements.  Algorithm  1 
alone  found  the  best  feasible  solution  three  times.  Of 
the  four  remaining  disagreements,  Algorithms  1,  2,  5, 
and  6  found  the  best  solution  twice,  Algorithms  1,  3,  5, 
and  7  found  the  best  solution  once,  and  Algorithms  1,  2, 
3,  5,  6,  and  7  found  the  best  solution  once.  These 
results  are  summarized  in  Table  6.9. 
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TABLE  6.9:  NUMBER  OF  TIMES  EACH  ALGORITHM  FAILS 
TO  FIND  THE  BEST  FEASIBLE  SOLUTION 

Alg.  Alg.  Alg.  Alg.  Alg.  Alg.  Alg.  Alg. 
12345678 

45684568 


The  problem  size  does  have  some  effect  on  the  CPU 

i 

time  elapsed  before  termination  is  reached.  The  Class  5 
problems  illustrate  a  difficulty  encountered  in  working 
with  the  mixed  integer  BLPP.  Although  the  problems  have 
only  30  variables,  10  of  which  are  integer,  the  problems 
generated  required  as  much  CPU  time  as  larger  problems. 

This  shows  the  problem  dependency  encountered  when 
trying  to  solve  the  mixed  integer  BLPP.  Depending  on 
the  problem  generated,  CPU  time  can  be  excessive  or 
quite  short.  This  problem  dependency  is  starkly 
illustrated  by  two  problems  in  Class  8.  The  difference 
in  CPU  time  for  two  problems  which  did  not  abnormally 
terminate  is  526  seconds.  This  difference  is  for 
Algorithm  1.  For  these  same  two  problems,  the 
difference  in  CPU  time  using  Algorithm  8  is  123  seconds. 

An  examination  of  the  data  shows  the  algorithms  can 
be  placed  in  order  based  on  average  CPU  time.  Although 
this  order  does  not  always  hold,  it  is  usually  true. 
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From  fastest  to  slowest,  the  rank  is  8,  6,  4,  2,  7,  5, 

3,  and  1.  As  noted  above,  some  sacrifice  must  be  made 
to  decrease  CPU  time.  Algorithms  4  and  8  failed  to 
reach  the  best  feasible  solution  found  by  one  or  more  of 
the  algorithms  on  eight  of  the  50  problems.  These 
algorithms  backtrack  when  a  solution  is  found  which 
satisfies  the  integrality  requirements  of  the  mixed 
integer  BLPP.  Similarly,  Algorithms  2  and  6  failed  to 
reach  the  best  feasible  solution  on  five  of  the  50 
problems.  They  backtrack  when  no  improvement  is 
provided  by  a  solution  which  satisfies  the  integrality 
requirements  of  the  mixed  integer  BLPP.  Algorithms  3 
and  7  failed  to  find  the  best  feasible  solution  on  six 
of  the  problems,  while  Algorithm  5  failed  on  four  of  the 
50  problems.  Algorithms  3  and  7  backtrack  when  the 
solution  of  problem  (6.2)  is  in  the  inducible  region  of 
the  mixed  integer  BLPP  problem,  and  Algorithm  5 
backtracks  when  the  solution  of  problem  (6.2)  is  not 
better  than  the  incumbent  solution.  The  backtracking 
rule  of  Algorithm  5  is  also  employed  in  Algorithms  6,  7, 
and  8.  If  the  best  possible  solution,  regardless  of  CPU 
time,  is  desired,  Algorithm  1  is  the  choice.  However, 
if  both  the  solution  and  CPU  time  are  important, 
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Algorithm  2  offers  a  good  compromise.  If  CPU  time  is  an 
important  concern,  Algorithm  8  is  the  proper  algorithm 
to  use . 

For  a  linear  mixed  integer  bilevel  programming 
problem,  the  algorithm  which  would  best  solve  the 
problem  is  Algorithm  2.  In  testing,  this  algorithm 
never  exceeded  the  vertex  limit  while  solving  a  problem. 
It  found  the  best  feasible  solution  on  45  of  the  50 
problems,  and  in  terms  of  CPU  time,  it  ranked  fourth. 

It  offers  a  good  balance  between  computational  effort 
and  ability  to  find  a  good  solution  of  the  mixed  integer 
BLPP . 
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CHAPTER  7 

THE  BILEVEL  PROGRAMMING  PROBLEM  AS  APPLIED  TO  A 
PRODUCTION  PLANNING  PROBLEM 

7 • 1  Introduction 

This  chapter  centers  on  a  production  planning 
problem  with  inexact  demand.  This  problem  is  modified 
by  creating  a  customer  who  determines  demand.  One  way 
of  modeling  the  situation  where  a  customer  controls 
demand  is  as  a  bilevel  programming  problem  (BLPP) .  Two 
variations  of  this  formulation  are  investigated. 

The  production  planning  problem  used  as  a  base  from 
which  to  develop  the  BLPP  formulations  comes  from  Bard 
and  Chatter jee  (1985).  Their  problem  has  a  manufacturer 
of  n  products  who  wishes  to  determine  a  production  mix 
that  will  maximize  her  profits  over  a  finite  time 
horizon,  T,  in  the  face  of  m  resource  constraints  and  an 
inexact  demand  forecast.  The  problem  follows. 
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Problem  7.1 


n  T  n  T 

Max  Z  Z  p.^d.^,  -  Z  Z  [c..x,.  +  h,*!. 


— «  «-  ~  ^  L  1 1  -j t  “it  It 

x, I , S , V  j=l  t=l  JZ  3Z  j=l  t=l  3  3  3t  3t 


+  SjtSjt  +  Vjt] 


(7.1a) 


subject  to 


djt  -  xjt  -  1 j , t-i  +  r3t  -  sjt  -  0  l  ;  ] . ”  <7-lb> 

^  J.  t  •  •  •  t  X 


Z  a ,  .  .x  . .  —  b .»  x.  1  —  1  »  •  •  .  ,m  (7.1c) 

j-1  13Z  3  t  =  1 . T 


Z  V.  <  e.  1  -  1,  .  .  . ,  A  (7. Id) 

3-1  3  t  -  1 . T 


Xjt  ~  °*  Sjt  ~  °'  Xjt  -  °'  Vjt  "  0  j  =  1 . n  <7-le) 


t  =  1 , . . . ,T 


dt  -  (dlt' *  * ’ ^nt5  €  Dt 


t  =  1, - T  (7. If ) 


where 


Xjt  is  the  amount  of  product  j  manufactured  in 


period  t; 


a^  .t  is  the  amount  of  resource  i  required  to  make 


product  j  in  period  t; 


bit  is  the  amount  of  resource  i  available  in  period 


is  the  amount  of  inventory  of  product  j  in 


period  t; 

is  the  amount  of  shortage  of  product  j 
in  period  t; 

Vj^  is  the  amount  spent  on  advertising  product  j  in 
period  t; 

e^  is  the  amount  of  money  available  in  constraint 
i  to  spend  on  advertising  in  period  t; 

Pjt  is  the  (known)  selling  price  of  product  j  in 
period  t; 

Cjt  is  the  (known)  unit  cost  of  manufacturing 
product  j  in  period  t; 

h^  is  the  (known)  unit  holding  cost  of  product  j 
in  period  t; 

Sjt  is  the  (known)  unit  cost  of  subcontracting 
product  j  in  period  t; 

djt  is  the  (inexact)  demand  forecast  for  product  j 
in  period  t  ; 

is  the  set  in  which  the  n-dimensional  vector  d^ 
lies  in  period  t. 

In  the  objective  function  (7.1a),  the  first  term 
represents  total  revenues  over  the  time  horizon  while 
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the  second  term  suras  the  individual  costs:  production, 
inventory,  shortage,  and  advertising.  Equation  (7.1b) 
is  the  material  balance  constraint,  and  (7.1c)  defines 
the  resource  usage  restrictions.  Equation  (7. Id) 
establishes  the  limits  on  advertising.  To  meet  a  demand 
which  exceeds  production  in  a  period,  the  manufacturer 
has  two  options.  She  can  meet  the  demand  with  inventory 
or  by  ordering  additional  product  from  a  subcontractor. 
The  manufacturer  can  also  order  excess  product  from  a 
subcontractor  and  place  the  excess  in  inventory,  so 
there  is  a  tradeoff  between  subcontracting  and  holding 
inventory. 

7 . 2  Formulation  as  a  BLPP 

If  the  demand  d^t  is  known  exactly,  then  is  a 
singleton,  and  (7.1)  reduces  to  a  standard  linear 
program.  Now,  if  demand  is  treated  as  a  random  variable 
with  some  known  distribution,  a  stochastic  linear 
program  is  formed.  Another  way  to  approach  this.-.  problem 
is  to  introduce  a  customer.  In  this  instance,  the 
problem  can  be  reformulated  as  a  BLPP  if  certain 
conditions  are  meet.  The  manufacturer  is  given  the  role 
of  the  leader  while  the  customer  is  cast  in  the  role  of 
the  follower.  To  place  the  customer  in  the  role  of 
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follower,  several  assumptions  are  made.  The  first  is 
that  the  customer  knows  the  price  of  each  product  in 
each  period  of  the  time  horizon.  The  second  assumption 
is  that  the  customer  is  rational.  That  is,  the  customer 
wants  to  minimize  his  costs  which  are  the  purchase 
prices  he  pays  for  products.  The  third  assumption  is 
that  the  customer  does  not  make  his  purchase  decisions 
until  the  manufacturer  announces  his  production  and 
advertising  decisions  for  the  time  horizon.  The  last 
assumption  is  that  the  manufacturer  wishes  to  satisfy 
demand  in  every  period.  As  a  consequence  of  the  last 
assumption,  the  customer  effectively  controls  inventory 
and  shortages  because  once  the  manufacturer  makes  her 
production  and  advertising  decisions,  the  customer 
determines  the  amount  of  inventory  or  shortage  in  each 
period  through  his  purchasing  decisions.  The  last 
assumption  also  has  an  impact  on  the  formulation  of  the 
BLPP .  The  manufacturer's  desire  to  satisfy  all  demand 
means  that  the  shortages  are,  in  reality,  an  amount  of 
product  which  must  be  subcontracted.  Since 
subcontracting  can  be  done  in  each  period,  the 
manufacturer  could  order  product  from  a  subcontractor  in 
a  period,  place  this  product  in  inventory,  and  use  it  to 
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meet  shortages  in  a  latter  period.  The  manufacturer  i 

i 

I 

would  do  this  if  a  future  shortage  could  be  predicted 

' 

and  the  cost  of  subcontracting  in  a  period  prior  to  the  < 

* 

predicted  shortage  plus  the  cost  of  inventory  were  less  j 

than  the  cost  of  subcontracting  in  the  period  for  which  ^ 

< 

the  shortage  is  predicted.  Now,  in  modeling  this  \ 

situation,  a  determination  as  to  how  to  treat  J 

subcontracting  must  be  made.  If  subcontracting  is  only 

allowed  in  periods  when  a  shortage  exists,  this  implies  i 

either  inventory  or  shortage  (or  both)  of  each  product  j 

in  every  period  t  is  zero.  If  the  manufacturer  is 

allowed  to  meet  a  shortage  in  a  period  by  subcontracting 

in  a  previous  period,  the  possibility  of  multiple 

responses  by  the  customer  to  the  manufacturer's  decision 

exists.  This  situation  occurs  because  the  formulation 

of  the  BLPP  gives  the  customer  control  over  product 

inventory  and  subcontracting.  When  a  shortage  arises, 

the  customer  can  either  select  subcontracting  in  the 

current  period  or  subcontracting  and  inventory  in  a 

previous  period.  Since  neither  choice  has  an  effect  on 

the  customer's  cost,  the  customer  may  or  may  not  make  a 

decision  which  allows  the  manufacturer  to  realize  the 

largest  profit  possible  from  a  given  set  of  decisions. 


It  is  difficult  to  determine  which  way  to  model  the 
shortages.  Only  allowing  subcontracting  in  the  period 
in  which  shortages  occur  is  realistic  because  the 
manufacturer  does  not  know  what  demand  is  prior  to  the 
current  period.  However,  subcontracting  and  placing  the 
product  in  inventory  allows  the  manufacturer  to 
anticipate  the  customer's  decision.  To  model  the  first 
situation  requires  the  introduction  of  a  quadratic 
penalty  term  in  the  customer's  objective  function.  By 
penalizing  the  customer  for  having  inventory  and  a 
shortage  in  the  same  period,  subcontracting  is  allowed 
only  in  periods  when  a  shortage  arises.  In  the  latter 
situation,  the  problem  of  multiple  optima  is  overcome 
when  the  BLPP  is  recast  in  its  equivalent  Kuhn-Tucker 
formulation.  In  this  formulation,  the  manufacturer's 
objective  function  (7.1a)  becomes  the  objective 
function,  and  this  means  the  occurrence  of 
subcontracting  product  for  inventory  purposes  will 
happen  only  when  it  is  of  benefit  to  the  manufacturer. 

The  following  problem  is  the  BLPP  derived  from  problem 
(7.1).  Notice  in  (7.2b)  that  the  customer's  problem  has 
been  recast  as  a  maximization  problem  to  allow 
application  of  the  algorithm  developed  in  Chapter  5. 
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Problem  7.2 

n  T  n  T 

Max  Z  Z  Pjtdjt  ~  Z  Z  [cjtXjt  +  h1tI1t 

x, v  j=i  t=i  J  J  3=1  t=i  J  J  J  J 

+  s3ts3t  +  v3t] 


where  I,  d,  and  S  solve 

n  T 

Max  Z  Z  -p  d 

I , d , S  j  =  l  t=l  J  J 


(7.2a) 


(7.2b) 


sub3ect  to 

x..  -  I.  .  ,  +  I..  -  S  . .  =  0 
3t  3 / t-1  Jt  jt 


Z  a.  ..x..  <  b.. 
ijt  jt  it 


. ,n  (7.2c) 
.  ,T 

. ,m  ( 7 . 2d) 
.  ,T 


n 

Z  V3t 
3=1  3 

“  eit 

i  = 
t  = 

l,  . 
l , . 

.  .  .£ 

.  •  r  T 

(  7 . 2e ) 

>  o,  ijt  >  0, 

v3t  -  0 

3  = 

t  = 

l ,  . 
l.  . 

.  .  ,n 
.  .  ,  T 

(  7 . 2  f  ) 

(dlt' - dnt} 

e  Dt 

t  = 

l ,  . 

.  .  .  T 

(  7 . 2g ) 

Problem  (7.2)  models  the  situation  where  the 
manufacturer  is  allowed  to  order  product  from  a 
subcontractor  and  place  it  in  storage  for  use  in  latter 
periods.  The  situation  where  the  manufacturer  can  only 
order  product  from  a  subcontractor  when  shortages  occur 
is  modelled  by  changing  the  customer's  ob3ective 


function,  (7.2b).  The  modified  objective  function  is 
n  T  n  T 

Max  Z  Z  -p  . .  d  . .  -  Z  Z  M  S.  I.  (7.2b) 

I ,d,S  j  =  l  t=l  3Z  j  =  l  t=l  3Z  3X 

where  M  represents  a  large  number  and  the  second  term  is 
a  penalty  for  having  both  a  shortage  and  inventory  in 
the  same  period.  The  second  term  in  the  modified 
objective  function  is  equivalent  to  adding  the 
complementarity  constraint  =  0  y  j,t  to  the 

problem.  One  way  to  model  these  constraints  in  a  linear 
problem  is  the  introduction  of  binary  variables.  To 
avoid  the  introduction  of  integer  variables,  the 
complementarity  constraint  is  added  to  the  objective 
function  as  a  penalty  term. 

The  formulation  of  (7.2)  allows  the  manufacturer  to 
have  an  unlimited  amount  of  inventory  on  hand.  It  also 
does  not  penalize  her  for  any  setup  costs  which  she 
might  incur.  Problem  (7.2)  can  be  modified  to  include 
both  setup  costs  and  a  limit  on  inventory.  The  addition 
of  an  upper  bound  on  inventory  would  constrain  the 
customer's  decision.  This  happens  when  the  customer 
wants  to  make  a  decision  which  would  cause  inventory  to 
exceed  its  upper  bound.  An  upper  bound  on  inventory  can 
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be  included  if  the  manufacturer  rents  extra  storage 
space  when  her  upper  limit  on  storage  space  is  reached. 
The  modeling  of  this  situation  can  be  accomplished  by 
using  binary  variables.  Binary  variables  are  also  used 
to  include  the  setup  costs.  The  revised  problem  is 


Problem  7 . 3 


Max 


n 

z 


T 

^  P  ,•  . . 


X , V , z  j=l  t=l  Jt 


n 

z 


j=l  t=l 
T 


Z  tc^x^  +  h.tI.t 


jt  jt 
T 


+  SJtSJt  +  VI  -  -  tl 


ft  Zt 


7.3a) 


where  I,  d,  S,  and  y  solve 
n  T 


Max  Z  Z  -p  d 

I , d ,y , S  j  =  l  t=l  3Z 


(7.3b) 


subject  to 


d3t  "  +  -  sjt =  0  J  =  1 . n  (7-3c» 


t  =  1, 


t  T 


n 


Z  a  .  . .  x  .  ^  <  b  .  , 
J=1  iJt  jt  it 


i  =  1 , . . . , m  (7.3d) 
t  =  1 . T 


n 


Z  V.„  <  e.fc 
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M  zjt  ■  xjt  -  0 

3 

t 

= 

l ,  .  . 
l ,  .  • 

.  ,  n 
.  ,  T 

(7.3g) 

°,  s.t  >  0,  Ijt  >  0,  v.t  >  0 

3 

t 

= 

i ,  •  . 
l ,  •  • 

•  ,  n 
.  ,T 

(7.3h) 

yt,  zt  e  {0,1} 

t 

= 

l.  .  . 

.  ,T 

(7.3i) 

dt  =  (dlt' * ‘ ' ,dnt)  6  Dt 

t 

= 

l,  . . 

.  ,  T 

(7.33) 

where 

M  is  a  large  number, 

r^  is  the  cost  of  renting  space  in  period  t; 

ft  is  the  setup  cost  for  production  in  period  t; 

Yt  is  a  binary  variable  which  indicates  if  space 
is  rented  (yt=l)  or  is  not  rented  (yt=0)  in 
period  t; 

z^  is  binary  variable  which  indicates  if  a  setup 
cost  is  incurred  (zt=l)  or  not  incurred  (zt=0) 
for  production  in  period  t; 

Bj  is  a  relative  measure  of  space  occupied  by 
product  j  and  is  normalized  to  product  1. 

In  (7.3),  constraint  (7.3f)  represents  the 
manufacturer's  need  to  rent  additional  storage  space, 
and  (7.3g)  is  the  constraint  related  to  setup  costs.  In 
(7.3),  the  manufacturer  pays  a  fixed  fee  to  rent  storage 
space,  so  she  pays  the  same  amount  to  rent  space  for  one 


item  or  500  items.  Problem  (7.3)  is  a  mixed  integer 
problem,  and  its  solution  will  require  the  use  of  the 
algorithms  for  the  mixed  integer  bilevel  programming 
problem  developed  in  Chapter  6. 

Notice  that  the  setup  costs  are  controlled  by  the 
manufacturer.  Since  these  costs  cannot  be  used  to 
control  the  customer's  decision  making  process,  their 
control  by  the  manufacturer  is  appropriate.  However, 
the  determination  concerning  renting  additional  storage 
space  must  be  modelled  as  a  customer  decision.  If 
control  of  this  were  given  to  the  manufacturer,  she 
could  use  it  to  constrain  the  customer's  decision.  The 
above  formulation  allows  the  manufacturer  to  meet 
shortages  in  a  given  period  by  ordering  product  from  a 
subcontractor  in  prior  periods.  As  in  (7.2),  if  this 
situation  is  not  allowed,  the  customer's  objective 
function,  (7.3b),  can  be  modified  to  prevent  this.  This 
can  be  done  by  including  a  penalty  term  in  (7.3b)  which 
charges  an  unacceptable  amount  for  having  shortages  and 
inventories  of  the  same  product  in  a  period.  The 
customer's  revised  objective  function  is  presented 


below. 
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n  T  n  T 

Max  Z  Z  -p.  d,  -  Z  Z  M  S.  I..  (7.3b) 

I ,  d  ,  S  j=l  t=l  3  j=l  t=l  J  ]T 

Unfortunately,  the  algorithms  for  the  mixed  integer 
BLPP,  as  currently  coded,  cannot  solve  problems  with 
quadratic  terms  in  the  follower's  objective  function. 
Rather,  this  situation  can  be  modelled  by  using  either- 
or  constraints  because  either  shortages  or  inventory  of 
a  product  in  a  period  must  be  zero.  This  requires  the 
addition  of  constraints  and  binary  variables  to  (7.3). 
The  additional  constraints  are 
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jt  ~  M  wjt  *  0 


jt  +  M  wjt  *  M 
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.  .  ,  n 

(7.3k) 

t  •-  1 , . 

.  .  ,  T 
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•  •  t  n 

(7.3)1) 

t  -  l, . 

.  .  ,  T 

j  =  l,. 

.  .  ,n 

(7.3m) 

t  =  l ,  . 

.  •  ,  T 

This  formulation  adds  n  x  t  binary  variables  and 
2(n  *  T)  constraints  to  (7.3). 

The  formulations  of  (7.2)  and  (7.3)  do  not  preclude 


the  constraints  and  still  allow  the  customer  to  minimize 
his  costs.  The  assumption  that  the  follower's  rational 
reaction  set,  ^(x*),  is  a  singleton  for  x*  optimal  may 
not  be  true  for  this  problem. 

7 . 3  Example  Problems 

Constraints  and  data  for  production  planning 
problems  in  the  form  of  (7.2)  and  (7.3)  were  created  to 
demonstrate  and  test  the  performance  of  the  algorithms 
presented  in  Chapters  5  and  6.  For  each  problem,  the 
number  of  products  is  n  =  2,  the  number  of  periods  is 
T  -  4 ,  the  number  of  resource  constraints  is  m  =  6,  the 
number  of  constraints  on  advertising  is  l  =  7 ,  and  the 
value  of  big  M  is  1500.  The  information  and  data  on  the 
problems  are  presented  in  the  following  tables. 
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TABLE  7.1:  PROBLEM  DATA 
Period 


Coefficient 

1 

2 

3 

4 

Pit 

75 

115 

160 

90 

*j 

CM 

0. 

115 

200 

300 

160 

O 

»-* 

rt 

50 

75 

100 

60 

C2t 

75 

95 

200 

100 

hlt 

25 

25 

25 

25 

S2t 

It 

25 

25 

25 

25 

80 

110 

140 

95 

S2t 

110 

170 

260 

140 

ft 

7500 

7500  7500 

7500 

rt 

3000 

3000  3000 

3000 

Also , 

tne  value  of 

IMax  is 

50 

in  each 

period,  B 

and  B2 

=  1.5. 

For 

the  six 

resource 

constraints 

matrix 

and  right-hand  side 

vector  are 

presented 

3 

3  3 

3 

0 

0 

0  0 

0 

0  0 

0 

2 

2 

2  2 

A 

*— 

2 

0  0 

0 

3 

0 

0  0 

0 

2  0 

0 

0 

3 

0  0 

0 

0  2 

0 

0 

0 

3  0 

0 

0  0 

2 

0 

0 

0  2 

and  b 

=  [2750,2000 

,  2700 , 2700  , : 

2700,2700] . 

1 


SI 


1 
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The  manufacturer's  marketing  department  has  done  an 
analysis  of  the  advertising  budget.  The  analysis  shows 
the  manufacturer  should  never  spend  more  than  $10,000  on 
advertising  and  should  never  spend  less  than  $1,500  on 
advertising  a  product  in  two  consecutive  periods.  These 
requirements  generate  seven  constraints.  The  A  matrix 
of  these  seven  constraints  is  shown  below.  The  first 
constraint  is  <  and  the  other  six  are  >. 

11111 
1  0  0  0  0 

1  1  0  0  o 

0  110  3 

0  0  0  1  1 

0  0  0  0  1 

0  0  0  0  0 

and  the  right-hand  side  vector  =  [10000,1500,1500,1500, 
1500,1500,1500] . 

The  analysis  also  reveals  information  about  the 
relation  between  advertising  and  sales.  The  advertising 
scheme  will  guarantee  a  demand  of  100  for  each  product. 
The  demand  for  the  products  is  also  related  to  the 
amount  of  advertising  done  before  and  during  a  period. 
For  each  dollar  spent  on  advertising  in  a  period,  a 


certain  amount  of  demand  is  generated.  The  following 


table  presents  this  information. 


TABLE  7.2:  PRODUCT  DEMAND  PER  DOLLAR  OF  ADVERTISING 


Product  1 


Period  in  which 
Advertising  done 


Demand  by  Period 
12  3  4 


1 

2 

3 

4 


0.050 


0.030 

0.035 


0.015 

0.020 

0.0325 


0.005 

0.010 

0.0175 

0.037 


Product  2 


Period  in  which 
Advertising  done 


Demand  by  Period 
12  3  4 


1  0.080 
2  - 

3  - 

4  - 


0.020  0.015  0.005 

0.040  0.020  0.010 

-  0.031  0.019 

-  -  0.039 


The  customer  also  has  product  requirements.  In 
purchasing  product  1,  for  each  unit  bought  in  period  1, 
two-thirds  of  a  unit  must  be  purchased  in  period  2;  for 
each  unit  bought  in  period  2,  one-half  of  a  unit  must  be 
purchased  in  period  3;  and  for  each  unit  purchased  in 
period  3,  three-fourths  of  a  unit  must  be  bought  in 
period  4.  In  purchasing  product  2,  for  each  unit  bought 
in  period  1,  one-half  of  a  unit  must  be  purchased  in 
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period  2;  for  each  unit  bought  in  period  2,  one-fourth 
of  a  unit  must  be  purchased  in  period  3;  and  for  each 
unit  purchased  in  period  3,  three-fifths  of  a  unit  must 
be  bought  in  period  4.  Using  this  information  and  the 
data  presented  in  Table  7,2,  the  set  D  is  formulated. 


d  +  d  +  d 

11  12  13 

+  d14 

> 

100 

d_,  +  d„„  +  d„  „ 
21  22  23 

+  d24 

> 

100 

2dll 

"  3d12 

< 

0 

ld12 

-  2d13 

< 

0 

3d13 

-  4d14 

< 

0 

ld21 

-  2d22 

< 

0 

ld22 

4d23 

< 

0 

3d23 

5d22 

< 

0 

l°°dH 

-  5V1X 

> 

0 

l°°d12  -  3Vll  - 

3'5V12 

> 

0 

100d13  - 

1 ’ 3V1 1  -2V12  ~  3 

•25V13 

> 

0 

°-5vll  - 

1V12  "  ^^IS  - 

3’7V14 

> 

0 

100d21 

'  8V21 

> 

0 

100d22  "  2V21 

-  4V22 

> 

0 

100d23 

-  1.5V21  -2V22  - 

3-1V23 

> 

0 

°-5V21  ' 

1V22  -  1 ’ 9V23  - 

3-9V24 

> 

0 

v  *Wi 


Problem  (7.2)  was  solved  for  the  case  where  the 

manufacturer  Is  allowed  to  anticipate  customer  demand. 

1  2 

For  this  problem,  n  =  16,  n  =24,  and  the  total  number 
of  constraints  is  37.  Although  the  manufacturer  had  the 
option  to  order  product  from  a  subcontractor  and  place 
it  in  inventory,  the  manufacturer  did  not  take  advantage 
of  this  option.  In  fact,  the  manufacturer's  optimal 
solution  does  not  order  any  product  from  a 
subcontractor.  Therefore,  it  is  not  necessary  to  solve 
the  modified  version  of  problem  (7.2)  where  the  option 
of  ordering  product  from  a  subcontractor  and  placing  the 
product  in  storage  is  eliminated. 

The  algorithm  of  Chapter  5  was  used  to  obtain  the 
solution  presented  in  Table  7.3.  The  manufacturer's 
profit  for  the  results  presented  in  Table  7.3  is 
$68,317.  The  algorithm  required  12.8  seconds  of  CPU 
time  to  solve  the  problem.  The  number  of  vertices  the 
algorithm  explored  was  267,  and  the  optimal  solution  was 
found  at  vertex  118.  Since  the  manufacturer  did  not 
purchase  any  product  from  a  subcontractor,  data  on 
subcontracting  is  omitted  from  Table  7.3. 


TABLE  7.3:  DEMAND,  PRODUCTION,  AND  INVENTORY 

SCHEDULE  OF  PROBLEM  (7.2) 


Variable 

1 

Period 

2  3 

4 

Product  1 
Production 

75.0 

121.25 

0.0 

53.4375 

Product  2 
Production 

440.0 

349.0 

0.0 

77.4 

Product  1 
Advertising 

1500.0 

0.0 

1500.0 

0.0 

Product  2 
Advertising 

5500.0 

0.0 

1500.0 

0.0 

Product  1 
Demand 

75.0 

50.0 

71.25 

53.4375 

Product  2 
Demand 

440.0 

220.0 

129.0 

77.4 

Product  1 
Inventory 

0.0 

71.25 

0.0 

0.0 

Product  2 
Inventory 


0.0 


129.0 


0.0 


0.0 


4i.-V  »*!••»• 


‘  A** 


4*»* 


Using  the  algorithms  presented  in  Chapter  6  and 

solving  problem  (7.3)  where  the  manufacturer  can 

subcontract  in  any  period  provided  some  interesting 

results.  For  this  problem,  n1  =  20  with  four  of  the 

2 

variables  binary,  n  =28  with  four  of  the  variables 
binary,  and  the  total  number  of  constraints  is  45. 

Seven  of  the  algorithms  arrived  at  a  solution  where  the 
manufacturer  made  $47,430,  and  one  algorithm  found  a 
solution  where  the  manufacturer's  profit  v.as  $45,351. 

The  algorithm  which  failed  to  find  the  best  result  was 
Algorithm  8.  The  solution  which  yields  a  $47,430  profit 
is  shown  in  Table  7.4.  As  can  be  seen  in  Table  7.4,  the 
manufacturer  rented  storage  space  in  periods  1  and  2  and 
incurred  setup  costs  in  period  1  by  manufacturing 
products  1  and  2 .  The  manufacturer  did  order  product 
from  a  subcontractor  in  period  4,  but  as  in  the  solution 
to  Problem  (7.2),  no  product  was  bought  from  a 
subcontractor  and  placed  in  storage.  This  alleviates 
the  need  to  solve  the  modified  version  of  Problem  (7.3) 
where  the  storage  of  subcontracted  product  is 
prohibited.  Table  7.4  is  shown  below. 


TABLE  7.4:  DEMAND,  PRODUCTION,  INVENTORY,  AND 

SUBCONTRACTING  SCHEDULE 
OF  PROBLEM  (7.3) 


Period 


Variable 

1 

2 

3 

4 

Product  1 
Production 

166 . 5 

0.0 

0.0 

0.0 

Product  2 
Production 

789.0 

o 

• 

o 

0.0 

0.0 

Product  1 
Advertising 

8812 . 5 

6187.5 

1500.0 

0.0 

Product  2 
Advertising 

5500.0 

0.0 

1500.0 

0.0 

Product  1 
Demand 

44.0625 

48.094 

74.344 

55.758 

Product  2 
Demand 

440.0 

220.0 

129.0 

77.4 

Product  1 
Inventory 

122 . 4375 

74.344 

0.0 

0.0 

Product  2 
Inventory 

349.0 

129.0 

0.0 

0.0 

Product  1 
Subcontracted 

0.0 

0.0 

0.0 

55 . 758 

Product  2 
Subcontracted 

0.0 

0.0 

0.0 

77.4 
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The  CPU  time  and  number  of  vertices  required  by 
each  algorithm  to  reach  termination  is  given  in  Table 
7.5.  The  vertex  where  each  algorithm  found  the  best 
solution  is  also  shown. 


TABLE  7.5:  RESULTS  OF  ALGORITHMS  FOR  PROBLEM  (7.3) 


Algorithm 

CPU  Time 
( min) 

Number  of 
Vertices 

Best  Solution 
Vertex 

1 

862.98 

510 

355 

2 

63.28 

70 

47 

3 

411.83 

252 

175 

4 

57.52 

66 

43 

5 

332.60 

194 

121 

6 

59.83 

64 

42 

7 

323.03 

182 

113 

8 

44.71 

54 

53 

Large  CPU  times  were  experienced  because  the  algorithms 
had  to  solve  many  relaxed  BLPPs  at  each  vertex  before 
reaching  a  solution  which  satisfied  the  integrality 
requirements.  Since  Algorithms  1  through  7  found  the 
best  solution  for  the  problem,  they  can  be  rank  ordered 
according  to  their  CPU  time.  The  rank  order  of  the 
seven  algorithms  from  fastest  to  slowest  is  4,  6,  2,  7, 
5,  3,  and  1.  In  Chapter  6,  the  rank  of  Algorithms  4  and 
6  is  reversed.  The  rank  order  in  Chapter  6  was  based  on 
average  CPU  time  achieved  solving  50  test  problems. 
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UNCLASSIFIED 


EXTENSIONS  TO  THE  MULTILEVEL  PROGRAMMING  PROOLEH(U)  AIR 
FORCE  INST  OF  TECH  NRIGHT-PNTTERSON  AFR  OH  J  T  MOORE 
AAV  M  AFIT/CI/NR-OO-123 


CHAPTER  8 


CONCLUSIONS 


8 • 1  Introduction 

In  the  previous  chapters,  various  versions  of  the 
bilevel  programming  problem  (BLPP)  have  been  examined. 
Algorithms  have  been  developed  which  solve  the  BLPP  with 
binary  variables,  with  continuous  variables,  and  with 
both  Integer  and  continuous  variables.  An  application 
of  BLPP  to  the  production  planning  problem  was  also 
explored.  Much  remains  to  be  done  in  developing 
applications  of  the  BLPP  and  in  formulating  algorithms 
for  the  BLPP.  The  multilevel  programming  problem  poses 
an  even  greater  research  challenge  as  much  remains  to  be 
done  in  expanding  the  understanding  and  uses  of  it. 

8 . 2  The  0-1  BLPP 

After  solving  approximately  200  randomly  generated 
problems,  experience  has  shown  that  a  wide  variation  in 
algorithmic  performance  exists,  even  for  problems  of  the 
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same  class.  And  while  the  number  of  variables  greatly 
affects  overall  computation  time,  little  can  be  inferred 
from  a  specific  example. 

These  observations,  coupled  with  the  fact  that  in 
most  instances  the  algorithm  quickly  finds  good  points 
in  the  inducible  region,  suggest  a  variety  of  heuristics 
for  speeding  convergence.  These  include:  1)  stopping 
after  a  given  number  of  vertices,  2)  stopping  after  a 
given  number  of  times  through  Step  1  or  Step  2,  and  3) 
altering  the  branching  rule.  The  first  two  follow  from 
what  appears  to  be  a  high  correlation  between  the  first 
and  the  last  four  columns  in  Table  4.1.  With  regard  to 
the  third,  one  branching  rule  that  was  tried  involved 
ordering  the  variables  according  to  their  coefficient 
value  in  the  leader's  objective  function.  On  average, 
however,  a  small  degradation  was  experienced.  Likewise, 
branching  on  the  variables  one  at  a  time  increased  the 
computational  effort  anywhere  from  50  to  1000  percent. 
Other  possibilities  are  currently  being  investigated. 

The  use  of  alternative  0-1  programming  algorithms 
begs  investigation.  The  use  of  more  advanced  algorithms 
such  as  ZOOM  which  is  the  0-1  version  of  the  linear 


programming  package  XMP  (Mars ten  1981)  may  improve  the 
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performance  of  the  0-1  BLPP  algorithm.  There  also  may  i 

t 

be  better  ways  to  approach  the  solution  of  the  0-1  BLPP. 

Alternative  formulations  may  prove  more  dynamic  than  the 
right-hand  parametric  formulation  developed  in  Chapter  j 

4  . 

Applications  of  0-1  BLPP  should  also  be  explored. 

One  area  where  research  may  prove  fruitful  is  in 

developing  road  systems.  The  leader  could  be  a  builder 

wishing  to  keep  road  construction  costs  low  while  the  \ 

follower  could  be  the  driving  public  who  wish  to 

minimize  travel  time.  Many  other  uses  for  the  0-1  BLPP 

are  awaiting  the  interested  researcher. 

8 . 3  The  Continuous  Variable  BLPP 

Experience  has  shown  that  even  for  the  simplest  of 
formulations,  the  bilevel  programming  problem  is 
inherently  difficult  to  solve.  The  branch  and  bound 
algorithm  developed  in  this  chapter  attempts  to  exploit 
seme  of  the  special  structure  in  the  problem,  and  in  so  \ 

doing,  is  able  to  achieve  rapid  convergence.  Linear 

J 

problems  with  up  to  100  variables  and  40  constraints  can 

: 


be  solved  in  less  than  300  seconds  on  average.  After 
thorough  testing,  the  algorithm's  performance  and 


robustness  is  seen  to  be  superior  to  virtually  all 
contenders . 


In  fact,  one  of  the  main  advantages  of  the  branch 
and  bound  approach  is  that  it  is  quite  general.  The 
analysis  centered  on  the  linear  formulation.  Solutions 
to  the  nonlinear  problem  still  require  study.  A 
possible  approach  is  substituting  a  nonlinear  computer 
code  such  as  MINOS  or  GRG2  for  the  XMP  library.  Another 
area  requiring  exploration  is  the  use  of  XMP  in  the 
branch  and  bound  scheme.  Although  the  capabilities  of 
XMP  are  utilized,  the  development  of  other 
representations  of  the  basis  inverse  and  the  data 
structure  may  improve  the  efficiency  of  the  BLPP 
algorithm. 

8 . 4  The  Mixed  Integer  BLPP 

This  area  requires  further  research.  Although  the 
algorithm  does  not  guarantee  the  uncovering  of  the 
optimal  solution,  a  more  rigorous  study  of  when  and  why 
the  algorithm  does  not  find  the  optimal  solution  is 
needed.  Currently,  if  the  algorithm  cannot  find  the 
optimal  solution  of  the  mixed  integer  BLPP,  uncertainty 
remains  as  co  whether  cr  not  the  problem  has  an  optimal 


solution.  The  development  of  a  test  to  determine  if  a 
problem  has  an  optimal  solution  is  needed. 

Computational  experience  shows  the  algorithm  is 
limited  in  its  ability  to  find  feasible  solutions  of  the 
mixed  integer  BLPP.  The  sizes  of  the  problems  solved 
are  modest,  and  the  CPU  times  required  to  solve  these 
problems  were  sometimes  large.  An  underlying  reason  for 
the  large  CPU  times  is  that  the  algorithm  must  solve  so 
many  problems.  At  each  vertex  of  the  branch  and  bound 
tree,  a  BLPP  is  solved.  If  this  solution  satisfies  the 
integer  requirements,  the  follower's  problem  must  also 
be  solved.  When  the  integer  requirements  are  satisfied, 
the  algorithm  cannot  backtrack;  it  continues  to  branch. 

Improvements  in  computational  efficiency  are 
needed.  If  the  algorithm  for  the  continuous  variable 
BLPP  can  be  improved,  the  mixed  integer  BLPP  algorithm 
would  improve.  Other  branching  schemes  need  to  be 
explored.  The  current  algorithm  uses  a  depth  only 
scheme,  A  breadth  only  approach  may  prove  useful,  and 
if  a  fathoming  rule  can  be  derived  for  this  approach, 
the  capabilities  of  the  algorithm  would  be  enhanced.  A 
test  which  might  prove  useful  is  one  which  would 
determine  when  further  branching  cannot  yield  an 
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improvement  in  the  leader's  objective  function.  Also, 
greater  use  of  the  coefficients  of  the  two  objective 
functions  might  lead  to  improved  branching  rules. 

8 • 5  Applications 

The  application  in  Chapter  7  highlights  an  area 
where  use  of  the  BLPP  may  be  appropriate.  It  also 
demonstrates  the  care  which  must  be  used  when  trying  to 
formulate  a  model  using  the  BLPP.  Although  control  of 
inventory  and  shortages  would  appear  to  belong  to  the 
manufacturer,  they  must  be  controlled  by  the  customer 
because  of  the  rules  which  must  be  observed  in  applying 
the  BLPP.  The  application  also  emphasizes  the  need  for 
improvement  in  the  computational  efficiency  of  the  mixed 
integer  BLPP  algorithm. 

8 . 6  Lessons  Learned 

The  development  of  algorithms  which  solve  various 
forms  of  the  BLPP  has  been  a  trying  experience.  The 
BLPP  is  conceptually  easy  to  grasp,  but  its  modeling  and 
application  are  difficult.  When  success  appeared  near, 
chasms  appeared  to  block  the  way.  The  mixed  integer 
BLPP  had  many  of  these.  The  discovery  of  simple 
problems  which  have  no  optimal  solution,  the  inabi  lity 
to  fathom  subproblems  with  integer  solutions,  and  the 


need  to  accommodate  the  fact  that  the  leader  does  not 
always  take  advantage  of  the  integrality  of  the 
follower's  variables  hindered  the  development  of  an 
efficient  algorithm.  Also,  determining  the  best  way  to 
order  the  algorithm  for  the  0-1  BLPP  was  a  frustrating 
task. 

Some  wisdom  was  gained  in  this  experience.  Just 
because  an  algorithm  and  its  associated  computer  code 
appears  to  solve  a  problem  is  no  reason  to  accept  it  as 
flawless.  Extensive  testing  and  application  is 
required.  Even  this  may  only  raise  the  confidence  that 
a  flawed  algorithm  works.  The  discovery  of  problems 
which  the  mixed  integer  BLPP  algorithm  did  not  solve 
occurred  only  after  many  problems  had  been  solved. 

Future  work  with  the  BLPP  and  other  areas  of  operations 
research  will  be  done  with  a  critical  eye  and  a 
reluctance  to  accept  things  as  gospel.  As  the  research 
developed,  the  possibilities  seemed  to  expand.  There 
are  many  areas  which  require  more  indepth  study.  As  the 
effort  progressed,  the  desire  to  return  to  the  beginning 
and  start  over  again  sometimes  became  great.  As  the 
work  invested  in  this  study  increased,  it  seemed  to 
generate  a  need  for  more  thought  and  work.  Hopefully, 


this  work  will  prove  to  be  useful  and  lead  to  further 
development  of  the  body  of  work  concerning  the  BLPP  and 
the  associated  multilevel  programming  problem. 


APPENDIX  A 


FORTRAN  COMPUTER  PROGRAMS 

A. 1  Introduction 

In  this  appendix,  the  computer  programs  which  are 
based  on  the  algorithms  developed  in  Chapters  4,  5  and  6 
are  presented.  Listings  of  the  programs  used  to 
generate  the  random  problems  and  read  data  for  example 
problems  are  also  included  in  this  appendix. 

A. 2  The  Program  Used  to  Generate  Random  Numbers 

The  following  program  was  written  by  the  computer 
consultants  at  the  University  of  Texas  at  Austin  and  is 
designed  to  generate  random  numbers  on  an  IBM  computer. 
The  program  is  based  on  the  work  of  Knuth  (1969).  This 
program  is  inserted  as  a  function  in  the  computer 
programs  which  generate  the  random  problems  used  to  test 
the  BLPP  algorithms  developed  in  Chapters  4,  5,  and  6. 
The  function  is  named  URAND  and  is  listed  below. 


ooo  oooo  oooo  ooo 
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REAL  FUNCTION  URAND  (IY) 
INTEGER  IY 


URAND  IS  A  UNIFORM  RANDOM  NUMBER  GENERATOR  BASED 
ON  THEORY  AND  SUGGESTIONS  GIVEN  IN  D.E. 
KNUTH  (1969),  VOL  2.  THE  INTEGER  IY  SHOULD 
BE  INITIALIZED  TO  AN  ARBITRARY  INTEGER  PRIOR  TO 
THE  FIRST  CALL  TO  URAND.  THE  CALLING  PROGRAM 
SHOULD  NOT  ALTER  THE  VALUE  OF  IY  BETWEEN 
SUBSEQUENT  CALLS  TO  URAND.  VALUES  OF  URAND  WILL 
BE  RETURNED  IN  THE  INTERVAL  (0,1). 


INTEGER  IA , IC , ITWO , M2 , M , MIC 
DOUBLE  PRECISION  HALFM 
REAL  S 

DOUBLE  PRECISION  DATAN, DSQRT 
DATA  M2 /O/, ITWO/ 2/ 

IF  (M2.NE.0)  GO  TO  20 


IF  FIRST  ENTRY,  COMPUTE  MACHINE  INTEGER  WORD  LENGTH 


M=1 

10  M2=M 

M=ITW0*M2 

IF  (M.GT.M2)  GO  TO  10 
HALFM=M2 


COMPUTE  MULTIPLIER  AND  INCREMENT  FOR  LINEAR 
CONGRUENT I AL  METHOD 


IA=8*IDINT ( HALFM* DATAN ( 1 . DO ) /8 . DO ) +5 

IC=2 * IDINT ( HALFM* ( 0 . 5D0-DSQRT ( 3 . DO ) / 6 . DO ) ) + 1 

MIC= ( M2-IC ) +M2 


S  IS  THE  SCALE  FACTOR  FOR  CONVERTING  TO 
FLOATING  POINT 


S=0. 5 /HALFM 


COMPUTE  NEXT  RANDOM  NUMBER 


20  IY=IY* IA 
C 

C  THE  FOLLOWING  STATEMENT  IS  FOR  COMPUTERS  WHICH 
C  DO  NOT  ALLOW  INTEGER  OVERFLOW  ON  ADDITION 
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C 

IF  (IY.GT.MIC)  I Y= { I Y-M2 ) -M2 
C 

IY=IY+IC 

C 

C  THE  FOLLOWING  STATEMENT  IS  FOR  COMPUTERS  WHERE  THE 
C  WORD  LENGTH  FOR  ADDITION  IS  GREATER  THAN  FOR 
C  MULTIPLICATION 

C 

IF  (IY/2.GT.M2)  IY= ( IY-M2 ) -M2 

THE  FOLLOWING  STATEMENT  IS  FOR  COMPUTERS  WHERE 
INTEGER  OVERFLOW  AFFECTS  THE  SIGN  BIT 

IF  (IY.LT.O)  IY= ( IY+M2 ) +M2 
URAND=FLOAT ( I Y ) *S 
RETURN 
END 


a 


a 
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Three  computer  programs  were  developed  to  support 
the  algorithm  for  the  0-1  BLPP .  They  are  listed  below. 
The  first  is  the  program  which  generated  the  random 
problems  which  were  used  to  test  the  0-1  BLPP  algorithm. 
The  second  program  is  designed  to  read  the  data  of  a  0-1 
BLPP  and  create  parametric  formulation  used  by  the  0-1 
BLPP  algorithm.  The  third  program  listed  below  is  the 
computerization  of  the  0-1  BLPP  alogorithm. 

A. 3.1  Program  for  Generating  Random  0-1  BLPP 

The  first  program  is  the  one  which  generates  the 
random  problems  used  to  test  the  0-1  BLPP  algorithm. 

The  function  URAND  is  called  by  this  program  and  is 
presented  in  section  A. 2.  This  program  requires  five 
data  entries.  The  entries  are 

the  number  of  variables  controlled  by  the  leader; 
the  number  of  variables  controlled  by  the  follower; 
the  number  of  constraints  in  the  problem; 
the  maximum  number  of  nonzero  entries  in  any  one 
column  of  the  A  or  B  matrix; 
the  random  number  seed. 

The  program  does  a  free  formated  read  of  the  above 
input.  Given  this  data,  the  program  creates  a  0-1  BLPP 
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in  its  parametric  formulation.  This  problem  can  then  be 
solved  using  the  algorithm  for  the  0-1  BLPP .  The 
variables  of  the  program  are  documented  in  the  listing 
which  follows. 
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PROGRAM  PURGEN 


*****PURPOSE 

PROGRAM  GENERATES  A  RANDOM  INTEGER  BLPP  WHERE  THE 
VARIABLES  ARE  BINARY.  THE  FUNCTION  URAND 
GENERATES  THE  RANDOM  NUMBERS.  SEE  THE  SECTION 
ON  URAND  FOR  A  LISTING  OF  THIS  CODE. 

♦♦♦VARIABLE  DEFINITIONS**  * 


ACC 

B 


CJ1 

CJ2 

COLLEN 

IY 

M 

MAXCOL 

MINMAX 

NUMCON 

NUMITR 

NUMX 

NUMXY 

NUMY 


ARRAY  WHICH  CONTAINS  THE  COEFFICIENTS  OF 
EACH  VARIABLE  IN  THE  A-MATRIX  OF  THE 
PARAMETRIC  FORMULATION  OF  THE  0-1  BLPP. 

THE  RIGHT  HAND  SIDE  ARRAY.  B(l)  IS  THE 
RIGHT-HAND  SIDE  OF  THE  LEADER'S  OBJECTIVE 
FUNCTION  AND  CORRESPONDS  TO  ALPHA.  B ( 2 ) 

IS  THE  SUM  OF  THE  VARIABLES  CONTROLLED  BY 
THE  LEADER  AND  CORRESPONDS  TO  BETA. 

ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

THE  NUMBER  OF  NONZEROS  IN  EACH  COLUMN  OF 
THE  PARAMETRIC  FORMULATION  OF  THE  0-1 
BLPP. 

RANDOM  NUMBER  SEED  OF  IY. 

NUMBER  OF  CONSTRAINTS  IN  THE  PARAMETRIC 
FORMULATION  OF  THE  0-1  BLPP. 

MAXIMUM  NUMBER  OF  NONZEROS  IN  ANY  COLUMN 
OF  THE  0-1  BLPP. 

FLAG  INDICATING  NATURE  OF  THE  PROBLEM. 

1  MEANS  MAXIMIZATION;  -1  MEANS 
MINIMIZATION.  FIXED  AT  1  IN  THIS  PROGRAM. 
THE  NUMBER  OF  CONSTRAINTS  IN  THE  0-1  BLPP. 
MAXIMUM  NUMBER  OF  VERTICES  ALLOWED  IN  THE 
BRANCH  AND  BOUND  TREE. 

THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER . 

THE  NUMBER  OF  VARIABLES  IN  THE  0-1  BLPP. 
THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER . 


ROWTYP  ARRAY  WHICH  INDICATES  THE  TYPE  OF 
CONSTRAINT : 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 

***END  VARIABLE  DEFINITIONS*** 

INTEGER  CNT , COLLEN ( 200 ) , ACC ( 200 , 200 ) ,B(200) , 

1  CJ1 ( 200 ) , C J2 { 200 ) , ROWTYP (200) , YA 

CHARACTER *4  DUMY 
DUMY= ' XSUB ' 

READ  (5,*)  NUMX , NUMY , NUMCON , NUMITR , MAXCOL , I Y 

MINMAX= 1 

M=NUMC0N+2 

B{ 1 ) =-9999 

B( 2 ) =0 

ROWTYP ( 1 ) =— 1 

ROWTYP ( 2 ) =-l 

*  *  *RANDOMLY  GENERATE  THE  RIGHT  HAND  SIDE  ARRAY 

AND  SET  ROWTYP E  EQUAL  TO  1.  ROWTYP E  CAN  BE 
ALTERED  BY  MODIFYING  THIS  LOOP*** 

DO  100  1=3, M 
ROWTYP  ( I )  =  1 
B ( I ) =URAND ( I Y ) *  4  5 . 0 
100  CONTINUE 

NUMX 1 =NUMX+ 1 
NUMXY =NUMX+NUM Y 

*  *  *  RANDOMLY  GENERATE  THE  COEFFICIENTS  OF  THE 

LEADER'S  AND  FOLLOWER'S  OBJECTIVE  FUNCTIONS*** 
DO  120  1=1, NUMXY 

IF  (I.LE.NUMX)  GO  TO  110 
CJ2{ I)=URAND( IY) *31 .0-15 .0 
110  CJ1 ( I ) =URAND ( IY) *26.0-10.0 

120  CONTINUE 

MAXC2=MAXC0L+MAXC0L+4 

•♦•RANDOMLY  GENERATE  THE  COEFFICIENTS  OF  THE 
A-  AND  B-MATRICES*** 

DO  130  1=1, NUMXY 
IR0W=2 
CNT=0 
JSTART=0 

IF  (CJ1(I) .EQ.O)  GO  TO  131 
JSTART=JSTART+2 


oooooo  ooo 


ACC ( I , JSTART-1 ) =1 
ACC ( I , JSTART ) =C J1 ( I ) 

CNT=CNT+1 

131  IF  (I.GT.NUMX)  GO  TO  139 

138  JSTART=JSTART+2 
ACC (I, JSTART-1) =2 
ACC ( I, JSTART )=1 
CNT=CNT+1 

139  JSTART=JSTART+1 

DO  140  J= JSTART, MAXC2 , 2 
141  YA=URAND(IY) *29.0-10.0 

IF  (YA.EQ.O)  GO  TO  141 

***ADJUST  THE  URAND(IY)  MULTIPLER  IN  THE  FOLLOWING 
LINE  TO  CHANGE  THE  PROBLEM  DENSITY.  CHANGING 
MAXCOL  ALSO  EFFECTS  THE  PROBLEM  DENSITY*** 
ROWNUM=URAND (IY)*3. 0+1.0 
I RO  W= RO  WNUM + 1  ROW 
IF( IROW.GT.M)  GO  TO  145 
ACC ( I ,  J ) =IROW 
ACC ( I , J+l ) =YA 
CNT=CNT+1 

140  CONTINUE 

145  COLLEN ( I ) =CNT 

130  CONTINUE 

***THE  REMAINDER  OF  THE  PROGRAM  WRITES  THE 

RANDOMLY  GENERATED  DATA  TO  A  FILE.  THE  DATA 
IS  FORMATTED  SO  IT  CAN  BE  READ  IN  BY  THE 
ALGORITHM  USED  TO  SOLVE  THE  0-1  BLPP*** 

WRITE  (6,908)  NUMX , NUMY , M , NUMITR 
908  FORMAT (415) 

DO  150  1=1, M 

WRITE  (6,910)  I , ROWTYP ( I ) , B ( I ) 

150  CONTINUE 
910  FORMAT (315) 

DO  170  1=1 , NUMXY 
ICOLL=COLLEN( I) 

ICOLL2=2*ICOLL 

WRITE  (6,915)  DUMY , I , ICOLL , C J2 ( I ) 

DO  180  J=1 , IC0LL2 , 2 
IB=ACC ( I , J ) 

WRITE  (6,920)  IB , ACC ( I , J+l ) 

180  CONTINUE 
170  CONTINUE 
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915  FORMAT ( A4 ,315) 
920  FORMAT ( 215 ) 
STOP 
END 


A. 3. 2  Program  Which  Creates  the  Parametric  Formulation 


of  a  0-1  BLPP 

The  following  program  is  used  to  read  the  data  of  a 
0-1  BLPP  and  create  its  parametric  formulation.  The 
program's  variables  are  defined  in  the  code,  and 
instructions  for  using  the  program  are  also  included  in 
the  listing. 
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PROGRAM  READ01 
*****PURP0SE 

THIS  PROGRAM  READS  IN  A  0-1  BILEVEL  PROGRAMMING 
PROBLEM  (BLPP)  AND  CREATES  THE  MATHEMATICAL 
PROGRAMMING  PROBLEM  WHICH  CAN  BE  SOLVED  TO  FIND 
THE  SOLUTION  OF  THE  0-1  BLPP. 

*****DIRECTI0NS  FOR  CREATING  AN  INPUT  FILE  FOR 
THIS  PROGRAM 

TO  CREATE  A  REPRESENTATION  OF  THE  BLPP  WHICH  CAN 
BE  SOLVED  USING  THE  ALGORITHM  PRESENTED  IN 
CHAPTER  4,  ENTER  THE  DATA  OF  THE  0-1  BLPP  AS 
OUTLINED  BELOW. 

THE  PROBLEM  SHOULD  BE  A  MAXIMIZATION  PROBLEM. 

THE  VARIABLES  SHOULD  BE  IN  A  SPECIFIC  ORDER. 

THE  VARIABLES  CONTROLLED  BY  THE  LEADER  SHOULD 
PRECEDE  THOSE  CONTROLLED  BY  THE  FOLLOWER. 

ALL  DATA  IS  INPUT  USING  FREE  FORMAT.  THIS  MEANS 
DATA  ON  A  CARD  ARE  SEPARATED  BY  COMMAS  OR  SPACES. 
EACH  "CARD"  OR  LINE  OF  DATA  REPRESENTS  AN  INPUT 
FIELD. 

************************************************** 
*  * 

*  NOTE:  ALL  ENTRIES  SHOULD  BE  INTEGER.  * 

*  * 

************************************************** 


THE  FIRST  LINE  OF  DATA  HAS  FOUR  ENTRIES.  THESE 
ENTRIES  PROVIDE  INFORMATION  ABOUT  PROBLEM 
STRUCTURE . 


THE  THREE  ENTRIES  ARE: 

ENTRY  1:  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER; 


ENTRY  2:  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER ; 

ENTRY  3:  NUMBER  OF  CONSTRAINTS  IN  THE  PROBLEM; 
ENTRY  4:  MAXIMUM  NUMBER  OF  VERTICES  ALLOWED  IN 
THE  BRANCH  AND  BOUND  TREE. 


‘4 
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C  THE  NEXT  SECTION  OF  ENTRIES  PROVIDES  INFORMATION 

C  ON  THE  CONSTRAINTS.  THE  INFORMATION  IS 

C  CONSTRAINT  NUMBER,  CONSTRAINT  TYPE,  AND  THE 

C  RIGHT-HAND-SIDE.  THE  CONSTRAINT  TYPES  ARE  AS 

C  FOLLOWS : 

C 

C  +1 — LESS  THAN  OR  EQUAL  TO; 

C  0— EQUALITY  CONSTRAINT; 

C  -1 — GREATER  THAN  OR  EQUAL  TO; 

C 

C  THE  RIGHT-HAND  SIDE  ENTRY  MUST  BE  POSITIVE. 

C  THERE  IS  ONE  LINE  OF  DATA  PER  CONSTRAINT. 

C  ENTRY  1:  ENTER  THE  CONSTRAINT  NUMBER; 

C  ENTRY  2:  ENTER  THE  CONSTRAINT  TYPE 

C  (EITHER  -1,0,  OR  +1) ; 

C  ENTRY  3:  ENTER  THE  RIGHT-HAND-SIDE 

C  OF  THE  CONSTRAINT ( >0 ) . 

C 

C  ENTER  INFORMATION  ON  EACH  VARIABLE.  THE  INPUTS 

C  ARE  THE  VARIABLE'S  POSITION  IN  THE  INPUT  SEQUENCE, 

C  THE  NUMBER  OF  NONZERO  COEFFICIENTS  IN  THE 

C  VARIABLE'S  COLUMN,  THE  VARIABLE'S  COEFFICIENT  IN 

C  THE  LEADER'S  OBJECTIVE  FUNCTION,  AND  THE 

C  VARIABLES'S  COEFFICIENT  IN  THE  FOLLOWER'S 

C  OBJECTIVE  FUNCTION.  AFTER  THIS  LINE  OF 

C  INFORMATION  FOR  A  VARIABLE  IS  ENTERED,  THEN 

C  ENTER  ONE  LINE  OF  DATA  FOR  EACH  NONZERO 

C  COEFFICIENT  IN  THE  VARIABLE'S  COLUMN.  TWO  VALUES 

C  ARE  REQUIRED:  THE  ROW  NUMBER  AND  THE  COEFFICIENT. 

C  AFTER  THIS  INFORMATION  HAS  BEEN  ENTERED  FOR  A 

C  VARIABLE,  PROCEED  TO  THE  NEXT  VARIABLE  AND  ENTER 

C  THE  INFORMATION  ON  IT. 

C 

C  THE  FIRST  FOUR  ENTRIES  ARE: 

C  ENTRY  1:  THE  VARIABLE  NUMBER; 

C  ENTRY  2:  NUMBER  OF  NON-ZERO  COEFFICIENTS  IN  THE 

C  VARIABLE'S  COLUMN  IN  THE  A  OR  B  MATRIX; 

C  ENTRY  3:  THE  VARIABLE'S  COEFFICIENT  IN  THE 

C  LEADER'S  OBJECTIVE  FUNCTION; 

C  ENTRY  4:  THE  VARIABLE'S  COEFFICIENT  IN  THE 

C  FOLLOWER'S  OBJECTIVE  FUNCTION  (NOTE: 

C  IF  THE  VARIABLE  IS  CONTROLLED  BY  THE 

C  LEADER,  AN  ENTRY  OF  0  IS  PERMITTED). 

C 


S 
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ENTER  THE  VARIABLE'S  NON-ZERO  COEFFICIENTS  IN  THE 
A  OR  B  MATRIX.  TO  ENTER  THIS  INFORMATION,  TWO 
DATA  ENTRIES  PER  LINE  ARE  MADE. 


ENTRY  1:  THE  ROW  NUMBER  IN  WHICH  THE  COEFFICIENT 
APPEARS ; 

ENTRY  2:  THE  COEFFICIENT. 


AFTER  ALL  NON-ZERO  COEFFICIENTS  OF  A  VARIABLE  HAVE 
BEEN  ENTERED,  GO  TO  THE  NEXT  VARIABLE  AND  ENTER 
INFORMATION  FOR  IT. 

*****END  OF  DIRECTIONS***** 


*  *  *  * ♦VARIABLES  DEFINITIONS***** 


COLLEN 


CONX 


CONY 


M INMAX 


NUMCON 

NUMITR 


ARRAY  WHICH  CONTAINS  THE  COEFFICIENTS  OF 
EACH  VARIABLE  IN  THE  A-  OR  B-MATRIX  OF  THE 
PARAMETRIC  FORMULATION  OF  THE  0-1  BLPP . 

THE  RIGHT  HAND  SIDE  ARRAY.  B ( 1 )  IS 
ASSOCIATED  WITH  THE  LEADER'S  OBJECTIVE 
FUNCTION  AND  CORRESPONDS  TO  ALPHA.  B(2) 

IS  ASSOCIATED  WITH  THE  SUM  OF  THE 
VARIABLES  CONTROLLED  BY  THE  LEADER  AND 
CORRESPONDS  TO  BETA. 

ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

THE  NUMBER  OF  NONZEROS  IN  EACH  COLUMN  OF 
THE  PARAMETRIC  FORMULATION  OF  THE  0-1 
BLPP. 

NUMBER  OF  CONSTRAINTS  CONTAINING  NO 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER. 

NUMBER  OF  CONSTRAINTS  IN  THE  PARAMETRIC 
FORMULATION  OF  THE  0-1  BLPP. 

FLAG  INDICATING  NATURE  OF  THE  PROBLEM. 

1  MEANS  MAXIMIZATION  AND  -1  MEANS 
MINIMIZATION.  FIXED  AT  1  IN  THIS  PROGRAM. 
THE  NUMBER  OF  CONSTRAINTS  IN  THE  0-1  BLPP. 
THE  MAXIMUM  NUMBER  OF  VERTICES  IN  THE 
BRANCH  AND  BOUND  TREE  CREATED  WHEN  SOLVING 
THE  0-1  BLPP. 
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NUMX 


THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER . 

NUMXY  THE  NUMBER  OF  VARIABLES  IN  THE  0-1  BLPP. 

NUMY  THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 

FOLLOWER. 

ROWTYP  ARRAY  WHICH  INDICATES  THE  CONSTRAINT  TYPE 
+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 

*  *  *  *  *  END  VARIABLE  DEFINITIONS***** 


INTEGER  COLLEN ( 200 ) , ACC ( 200 , 200 ) ,B(200) , 

1  CJ1(200) ,CJ2( 200) , ROWTYP (200) 

CHARACTER* 4  DUMY 
DUMY= ' XSUB ' 

***READ  PROBLEM  INFORMATION*** 

READ  (5,*)  NUMX, NUMY, NUMCON , NUMITR 

MINMAX=1 

M=NUMC0N+2 

NUMX 1 = NUMX + 1 

NUMXY = NUMX+ NUMY 

***SET  B(l)  AND  B ( 2 ) — THEY  CORRESPOND  TO  ALPHA  AND 
BETA  IN  THE  ALGORITHM.*** 

B ( 1 ) =—9999 
B ( 2 ) =0 

ROWTYP ( 1 ) =-l 
ROWTYP ( 2 ) =- 1 

***READ  IN  DATA  ON  THE  CONSTRAINTS*** 

DO  120  1=3, M 

READ  ( 5 , * )  NUMCON , ROWTYP ( I ) , B ( I ) 

120  CONTINUE 

***READ  IN  DATA  ON  THE  VARIABLES*** 


130 


50 


K=1 

READ  (5,*)  NUMVAR , COLLEN ( K) ,CJ1(K) ,CJ2(K) 
LSTART=0 

IF  (CJ1(K) .EQ.O)  GO  TO  50 

LSTART=LSTART+2 

COLLEN ( K ) =COLLEN ( K) +1 

ACC ( K , LSTART- 1 ) = 1 

ACC ( K , LSTART ) =C J 1 ( K ) 

CONTINUE 

IF  (K.GT.NUMX)  GO  TO  60 
LSTART=LSTART+2 
ACC(K, LSTART- 1 ) =2 
ACC (K, LSTART) =1 
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COLLEN < K ) =C0LLEN ( K ) + 1 
60  CONTINUE 

COLL2=COLLEN ( K ) +C0LLEN ( K ) 

LSTART=LSTART+ 1 

DO  140  L=LSTART , C0LL2 , 2 

READ  (5,*)  ACC { K,  L } , ACC ( K , L+l ) 

ACC ( K , L ) =ACC ( K , L ) +2 
140  CONTINUE 
K=K+1 

IF  (K.GT.NUMXY)  GO  TO  145 
GO  TO  130 
145  CONTINUE 
C 

C  *  *  *  END  DATA  INPUT*** 

C 

C  ***BEGIN  CREATION  OF  THE  DATA  SET  FOR  0-1  BLPP 

C  ALGORITHM*** 

C 

C  ***WRITE  BASIC  PROBLEM  INFORMATION*** 

WRITE  (6,908)  NUMX , NUMY , M , NUMITR 
900  FORMAT (415) 

C  ** ‘WRITE  CONSTRAINT  INFORMATION*** 

DO  150  1=1, M 

WRITE  (6,910)  I , ROWTYP ( I ) , B ( I ) 

150  CONTINUE 
910  FORMAT ( 315 ) 

C  ** ‘WRITE  VARIABLE  INFORMATION*** 

DO  170  1=1, NUMX Y 
ICOLL=COLLEN ( I ) 

IC0LL2=2 * ICOLL 

WRITE  (6,915)  DUMY , I , ICOLL , C J2 ( I ) 

DO  180  J=1 , IC0LL2 , 2 
IB=ACC ( I , J ) 

WRITE  (6,920)  IB , ACC ( I , J+l ) 

180  CONTINUE 
170  CONTINUE 
915  FORMAT ( A4 ,315) 

920  FORMAT (215) 

STOP 

END 
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The  following  program  is  the  computerized  version 
of  the  algorithm  for  the  0-1  BLPP .  The  input  for  the 


program  is  a  0-1  BLPP  which  is  formulated  in  its 
parametric  right-hand  side  representation.  The  program 
of  section  A. 3.1  creates  random  0-1  BLPPs  in  this  form, 
and  the  program  of  section  A. 3. 2  converts  the  data  of  a 
0-1  BLPP  into  the  proper  form.  The  program  which  solves 
the  0-1  BLPP  follows  and  is  documented  in  line. 
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PROGRAM  BLPP01 


*****PURPOSE 

THE  PROGRAM  READS  IN  THE  PARAMETRIC  FORMULATION 
OF  THE  0-1  BLPP  AND  FINDS  THE  SOLUTION  OF  THE  0-1 
BLPP  PROBLEM.  THE  DATA  IS  REFORMATTED  SO  A 
0-1  INTEGER  PROGRAMMING  PROBLEM  USING  A  BALAS 
ADDITIVE  ALGORITHM  CAN  BE  USED. 

••♦VARIABLE  DEFINITIONS*** 


A 

B 


BIFLG 

BSTNOD 

CJ1 

CJ2 


COL 

COLLEN 

DRHS 

FDUM 

FEAS 


ARRAY  CONTAINING  THE  NON-ZERO  COEFFICIENTS 
OF  THE  VARIABLES  IN  THE  A-  AND  B-MATRICES. 
THE  RIGHT  HAND  SIDE  ARRAY.  B ( 1 )  IS 
ASSOCIATED  WITH  THE  LEADER'S  OBJECTIVE 
FUNCTION  AND  CORRESPONDS  TO  ALPHA.  B(2) 

IS  ASSOCIATED  WITH  THE  SUM  OF  THE 
VARIABLES  CONTROLLED  BY  THE  LEADER  AND 
CORRESPONDS  TO  BETA. 

FLAG  USED  BY  0-1  SOLVER.  0  MEANS  FIND 
THE  OPTIMAL  SOLUTION.  1  MEANS  FIND  A 
FEASIBLE  SOLUTION. 

VERTEX  AT  WHICH  INCUMBENT  SOLUTION  FOUND. 
ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS.  THESE  COEFFICIENTS 
ARE  THE  COEFFICIENTS  OF  THE  OBJECTIVE 
FUNCTION  OF  THE  PARAMETRIC  FORMULATION  OF 
THE  0-1  BLPP. 

ARRAY  CONTAINING  THE  STARTING  POSITION  IN 
A  OF  EACH  VARIABLE'S  COLUMN. 

THE  NUMBER  OF  NONZEROS  IN  EACH  COLUMN  OF 
THE  PARAMETRIC  FORMULATION  OF  THE  0-1 
BLPP. 

ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM. 
WORKING  ARRAY  VERSION  OF  RHS  USED  TO  CHECK 
SOLUTION  FEASIBILITY  AND  CHOOSE  A 
SEPARATION  VARIABLE. 

USED  IN  BALAS  ADDITIVE  ALGORITHM.  SUMS 
THE  ELEMENTS  OF  ARRAY  RHS  WHICH  ARE 
NEGATIVE.  USED  TO  CHECK  FOR  FEASIBILITY 
OF  CURRENT  VALUES  OF  VARIABLES. 

USED  IN  BALAS  ADDITIVE  ALGORITHM.  A  FLAG 
USED  TO  INDICATE  IF  SEPARATING  ON  A  FREE 
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IDUM 

IEQ 

INF 

J 

KL 

M 

NODE 

NUMCON 

NUMX 

NUMXY 

NUMY 

OUTLEV 

RHS 

ROWNOS 

ROWTYP 


S 


SO 
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VARIABLE  IS  FEASIBLE.  0  MEANS  STILL 
FEASIBLE.  NOT  0  MEANS  INFEASIBLE. 

USED  IN  BALAS  ADDITIVE  ALGORITHM  TO 
DETERMINE  THE  CONTRIBUTION  OF  EACH  FREE 
VARIABLE  TO  PROBLEM  INFEASIBILITY. 

ARRAY  USED  TO  CONVERT  THE  PARAMETRIC 
FORMULATION  OF  THE  0-1  BLPP  INTO  A  FORM 
COMPATIBLE  WITH  BALAS'  ADDITIVE  ALGORITHM. 
USED  TO  DEAL  WITH  EQUALITY  CONSTRAINTS. 
USED  IN  BALAS  ADDITIVE  ALGORITHM.  IT  IS 
THE  CONTRIBUTION  TO  INFEASIBILITY  OF  EACH 
FREE  VARIABLE. 

USED  IN  THE  BALAS  ADDITIVE  ALGORITHM.  IT 
IS  THE  INDEX  OF  THE  SEPARATION  VARIABLE. 
CURRENT  TREE  LEVEL  IN  THE  INNER  TREE. 
NUMBER  OF  CONSTRAINTS  IN  THE  PARAMETRIC 
FORMULATION  OF  THE  0-1  BLPP. 

NUMBER  OF  VERTICES  IN  OUTER  BRANCH  AND 
BOUND  TREE. 

THE  NUMBER  OF  CONSTRAINTS  IN  THE  0-1  BLPP. 
THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER. 

THE  NUMBER  OF  VARIABLES  IN  THE  0-1  BLPP. 
THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER . 

LEVEL  OF  THE  CURRENT  VERTEX  IN  THE  OUTER 
BRANCH  AND  BOUND  TREE. 

ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM 
TO  STORE  THE  CURRENT  RIGHT-HAND  SIDE  OF 
EACH  CONSTRAINT. 

ARRAY  CONTAINING  THE  ROW  NUMBER  OF  EACH 
NONZERO  COEFFICIENT  IN  THE  A-  AND  B- 
MATRICES . 

ARRAY  WHICH  INDICATES  THE  TYPE  OF 
CONSTRAINT: 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 

ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM 
SHOWING  THE  SEPARATION  VARIABLES  OF  THE 
INNER  BRANCH  AND  BOUND  TREE.  S(K)  IS  THE 
INDEX  OF  SEPARATION  VARIABLE  AT  LEVEL  K. 
ARRAY  SHOWING  THE  SEPARATION  VARIABLES  OF 
OUTER  BRANCH  AND  BOUND  TREE.  SO(I)  IS  THE 
INDEX  OF  SEPARATION  VARIABLE  AT  LEVEL  I. 


j. 
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TRANS 


XBEST 


XFEAS 


XFIX 


XSET 


XYBEST 


ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM 
WHICH  CONTAINS  THE  SUM  OF  THE  NEGATIVE 
COEFFICIENTS  OF  THE  FREE  VARIABLES  IN 
EACH  CONSTRAINT. 

ARRAY  USED  TO  TRANSFORM  SOLUTION  PROVIDED 
BY  BALAS'  ADDITIVE  ALGORITHM. 

ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM 
INDICATING  WHETHER  OR  NOT  THE 
ALTERNATIVE  VERTICES  HAVE  BEEN  EXPLORED. 
V(I)=0  MEANS  THE  ALTERNATIVE  HAS  NOT  BEEN 
EXPLORED  AT  LEVEL  I; 

V(I)=1  MEANS  THE  ALTERNATIVE  HAS  BEEN 
EXPLORED . 

ARRAY  INDICATING  WHETHER  OR  NOT  THE 
ALTERNATIVE  VERTICES  HAVE  BEEN  EXPLORED. 
V0(l)=0  MEANS  THE  ALTERNATIVE  HAS  NOT  BEEN 
EXPLORED  AT  LEVEL  I; 

V0(I)=1  MEANS  THE  ALTERNATIVE  HAS  BEEN 
EXPLORED . 

ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM. 
W(I)=0  MEANS  VARIABLE  I  IS  FREE; 

W(I)«-K  MEANS  VARIABLE  I  SET  TO  0  AT  LEVEL 
K  OF  INNER  BRANCH  AND  BOUND  TREE; 
W(I)=K  MEANS  VARIABLE  I  SET  TO  1  AT  LEVEL 
K  OF  INNER  BRANCH  AND  BOUND  TREE. 

ARRAY  WHICH  STORES  THE  INCUMBENT  SOLUTION 
OF  THE  0-1  BLPP . 

FLAG  WHICH  INDICATES  FEASIBILITY  OF  THE 
0-1  PROBLEM  AT  THE  CURRENT  VERTEX  OF  THE 
OUTER  BRANCH  AND  BOUND  TREE.  0  MEANS 
FEASIBLE.  1  MEANS  INFEASIBLE. 

ARRAY  USED  TO  FIX  THE  VARIABLES  CONTROLLED 
BY  THE  LEADER  AT  0  OR  1 . 

ARRAY  WHICH  TRACKS  WHICH  VARIABLES 
CONTROLLED  BY  THE  LEADER  ARE  SET  TO  0  OR 
1  IN  THE  OUTER  BRANCH  AND  BOUND  TREE. 

XSET { J ) =0  MEANS  VARIABLE  J  IS  FREE, 

XSET ( J ) <0  MEANS  VARIABLE  J  SET  TO  0, 

XSET ( J ) >0  MEANS  VARIABLE  J  SET  TO  1. 

ARRAY  WHICH  STORES  THE  SOLUTION  AT  THE 
CURRENT  VERTEX  OF  THE  OUTER  BRANCH  AND 
BOUND  TREE  WHEN  THE  FREE  VARIABLES 
CONTROLLED  BY  THE  LEADER  ARE  NOT  FIXED. 
ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM 
TO  STORE  THE  VALUES  OF  THE  VARIABLES. 
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YBEST  ARRAY  WHICH  STORES  THE  SOLUTION  AT  THE 
CURRENT  VERTEX  P*  THE  OUTER  BRANCH  AND 
BOUND  TREE  WHEN  LiE  FREE  VARIABLES 
CONTROLLED  BY  THE  LEADER  ARE  FIXED 
AT  THEIR  VALUE  IN  XYBEST .  THUS  YBEST 
ALWAYS  CONTAINS  A  FEASIBLE  SOLUTION  OF 
0-1  BLPP.  DETERMINED  IN  BALAS  ADDITIVE 
ALGORITHM. 

YFEAS  ARRAY  USED  IN  BALAS  ADDITIVE  ALGORITHM  TO 
STORE  A  FEASIBLE  SOLUTION. 

YJ  USED  IN  BALAS  ADDITIVE  ALGORITHM.  IT  IS 

THE  DIRECTION  OF  EXPLORATION  FOR  THE 
SEPARATION  VARIABLE  (0  OR  1). 

Z1  VALUE  OF  THE  INCUMBENT  SOLUTION. 

Z1A  VALUE  OF  THE  SOLUTION  AT  THE  CURRENT 

VERTEX 

Z2BEST  VALUE  OF  THE  OPTIMAL  SOLUTION  FOUND  BY  THE 
BALAS  ADDITIVE  ALGORITHM. 

Z2  USED  IN  BALAS  ADDITIVE  ALGORITHM  TO  TEST 

IF  A  SOLUTION  CAN  BE  FATHOMED. 

Z2FEAS  USED  IN  BALAS  ADDITIVE  ALGORITHM  TO  TEST 
FEASIBILITY  OF  CURRENT  SOLUTION. 

Z2FIX1  USED  IN  BALAS  ADDITIVE  ALGORITHM.  IT  IS 
THE  SUM  OF  THE  OBJECTIVE  FUNCTION 
COEFFICIENTS  OF  THOSE  VARIABLES  WHICH  ARE 
FIXED  AT  1. 

*  *  *  END  VARIABLE  DEFINITIONS*** 


*»***NOTE***** 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 

Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 
*****END  OF  NOTE***** 
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IMPLICIT  INTEGER  (A-Z) 

REAL  DEN , BIDEN 

DIMENSION  XFIX(IOO) ,XSET(200) , VO (200) , SO (200) 
DIMENSION  COL ( 200) ,ROWNOS(800) ,B( 100) , A(800) 
DIMENSION  ROWTYP ( 100 ) , IEQ(IOO) , TRANS (200) 
DIMENSION  W( 200 ) ,V(200) ,S(200) ,RHS(100) ,DRHS(100) 
DIMENSION  YBEST (200) .XYBEST (200) ,CJ2(200) 
DIMENSION  YFEAS (200) ,Y(200) ,T(100) ,CJ1(200) 
DIMENSION  XBEST ( 200 ) 

CHARACTER* 4  DUMY.XSUB 


C 


oooo  ooooo 


c 

BI6-9999 
XSUB= 1 XSUB ' 

C  ***READ  IN  PATION*  *  * 

READ  (5,900)  NUMX , NUMY , M, NUMITR 
WRITE ( 6 , 901 )  NUMX, NUMY, M 

900  FORMAT (315) 

901  FORMAT {'  X  VAR=  SIS,*  Y  VAR=  ',15,'  C0N=  ',15) 
NUMXY =NUMX+NUMY 
ASIZE=NUMXY* (M-2 ) 

MT=M 

DO  10  1=1, NUMXY 
TRANS ( I ) =0 
10  CONTINUE 


a 


***READ  IN  ROW  TYPES  AND  RIGHT-HAND-SIDES 
ISEQ  REPRESENTS  THE  ROW  NUMBER*** 


DO  100  1=1, MT 

READ( 5 , 902 )  ISEQ , ROWTYP( I ) , B ( I ) 
IF  ( ROWTYP ( I ) . NE . 0 )  GO  TO  99 
IC=IC+2 
M=M+1 

ROWTYP ( I ) =1 
ROWTYP (M)=0 
IEQ { IC-1 ) =1 
IEQ ( IC ) =M 
B (M) =-B ( I ) 

99  IF  ( ROWTYP ( I ) . EQ . - 1 )  B(I)=-B(I) 

100  CONTINUE 

902  FORMAT (315) 


***READ  IN  COLUMNS  ONE  AT  A  TIME  AND  UPDATE 
MATRICES*** 

AC0UNT=0 

BICNT=0 

BISIZE=NUMXY*M 
COL ( 1 ) = 1 

DO  120  1=1, NUMXY 
ICNT=0 

READ ( 5 , 904 )  DUMY , JSEQ , COLLEN , C J2 ( I ) 

IF  ( DUMY . NE . XSUB )  GO  TO  999 
COL ( 1+1 ) =COL ( I ) +COLLEN 


i- 

V 
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KSTART=C0L(I) 

KST0P=C0L ( 1+1 ) -1 

IF  ( KSTART . GT . KSTOP )  GO  TO  999 

DO  130  K=KSTART , KSTOP 

READ ( 5 , 906 )  ROWNOS ( K) , A{ K) 

BICNT=BICNT+1 

IJ=ROWNOS(K) 

IF  (IJ.EQ.l)  CJ1 ( I ) =A ( K) 

IF  (IJ.GE.3)  AC0UNT=AC0UNT+1 

IF  ( ROWTYP ( I J ) . EQ . 1 )  GO  TO  130 

IF  (ROWTYP ( I J) .EQ.-l)  GO  TO  129 

ICNT=ICNT+1 

COL { 1+1 ) -COL ( 1+1 ) +1 

DO  125  IC=1 , MT , 2 

IF  (IEQ(IC) .EQ.IJ)  GO  TO  127 
125  CONTINUE 

127  ROWNOS (KST0P+ICNT)=IEQ( IC+1 ) 

A ( KSTOP+ICNT ) =- A ( K ) 

GO  TO  130 

129  A(K)=-A(K) 

130  CONTINUE 
120  CONTINUE 

904  FORMAT (A4, 315) 

906  FORMAT (215) 

***MAKE  ALL  OBJECTIVE  FUNCTION  COEFFICIENTS 
NONPOSITIVE*** 

DO  200  I=NUMX , NUMXY 

IF  ( C J2 ( I ) . LE . 0 )  GO  TO  200 
KSTART=COL ( I ) 

KSTOP=COL ( 1+1 ) - 1 
DO  150  K=KSTART , KSTOP 
IJ=ROWNOS(K) 

B ( I J ) =B ( I J ) -A ( K) 

A(K)=-A(K) 

150  CONTINUE 

CJ2 ( I ) =-C J2 ( I ) 

TRANS ( I ) =1 
200  CONTINUE 


***THE  OUTER  LOOP  BEGINS*** 
•‘•INITIALIZE  VARIABLES*** 
0UTLEV=0 


o  o  o  o  o 
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XFEAS=1 

DO  250  1=1 , NUMX 
S0(I)=0 
V0(I)=0 
XBEST { I ) =0 
XSET ( I ) =0 
XYBEST ( I ) =0 
XFIX{ I } =0 
250  CONTINUE 
B ( 1 ) =9999 
Z2BEST=-9999 
N0DE=0 
Zl=9999 

CALL  CPTIME ( TOTCP 1 , VIRCP 1 ) 

C  ***CALL  THE  BALAS  ADDITIVE  ALGORITHM*** 

305  CALL  BALAS { XFIX, XFEAS , BIFLG , XYBEST , Z2BEST , B , 

1  A, CJ2, COL, ROWNOS, BIG, NUMXY, 

2  M , NUMX , NUMY ) 

***IF  PROBLEM  IS  INFEASIBLE,  GO  TO  500  AND 

BACKTRACK*** 

IF  ( XFEAS. NE.O)  GO  TO  500 
DO  307  1=1 , NUMX Y 

YBEST ( I ) =XYBEST { I ) 

307  CONTINUE 

IF  (OUTLEV.EQ.O)  GO  TO  310 

***FIND  A  FEASIBLE  SOLUTION  OF  THE  0-1  BLPP*** 
CALL  BIFEAS { XFIX, Z2BEST, YBEST, B, A, CJ2 , COL, 

1  ROWNOS , BIG , NUMXY , M , NUMX , NUMY ) 

***CHECK  FOR  IMPROVEMENT  ON  CURRENT  INCUMBENT 
SOLUTION*** 

310  Z1A=0 

DO  320  1=1, NUMXY 
K=COL ( I ) 

IF  (YBEST ( I ) . EQ . 0 )  GO  TO  330 
IF  ( ROWNOS ( K) .NE. 1)  GO  TO  330 
Z1A=Z1A+A(K) 

320  CONTINUE 

IF  (Z1A.GE.Z1)  GO  TO  335 
C  ** ‘UPDATE  THE  INCUMBENT  SOLUTION*** 

Z1=Z1A 

BSTNOD=NODE 

DO  330  1=1, NUMXY 

XBEST ( I ) =YBEST ( I } 

330  CONTINUE 

C  *  *  *  INCREASE  SUM  OF  X  VARIABLES*** 


1 


a  a  o  o  o  o 


335  SUMX=0 

DO  340  1=1, NUMX 

SUMX=SUMX+YBEST{ I ) 

340  CONTINUE 

IF  ( OUTLEV . EQ . 0 )  XFIRST=SUMX 
B ( 1 ) =Z1-1 
B ( 2 ) =-SUMX- 1 

C  ***SELECT  A  BRANCHING  VARIABLE*** 

DO  360  1=1, NUMX 

IF  (YBEST(I) .EQ.O)  GO  TO  360 
IF  (XSET(I) .NE.O)  GO  TO  360 
0UTLEV=0UTLEV+1 
XSET ( I ) =OUTLEV 
SO ( OUTLEV )=I 
N0DE=N0DE+1 
360  CONTINUE 
GO  TO  600 

••♦BACKTRACK— DOES  BACKTRACK  IN  OUTER  TREE*** 

500  IF  (OUTLEV. EQ.O)  GO  TO  750 

IF  (VO(OUTLEV) .EQ.O)  GO  TO  550 
XSET ( SO ( OUTLEV ) )=0 
VO ( OUTLEV )=0 
0UTLEV=0UTLEV-1 
GO  TO  500 
550  VO ( OUTLEV) =1 

XSET ( SO ( OUTLEV ) ) =-XSET ( SO ( OUTLEV ) ) 

N0DE=N0DE+1 
B( 1 )=Z1-1 
B( 2 ) =0 

***SET  XFIX  FOR  BALAS  ADDITIVE  ALGORITHM*** 

600  IF  ( NODE . GT . NUMITR )  GO  TO  745 
DO  610  1=1, NUMX 
XFIX { I ) =XSET ( I ) 

610  CONTINUE 
BIFLG=1 
XFEAS=1 
Z2BEST=-9999 
GO  TO  305 

♦••TRANSFORM  VARIABLES  TO  ORIGINAL  FORM  FOR 
OPTIMAL  SOLUTION*** 

745  WRITE  (6,746) 

746  FORMAT ( '  THE  FOLLOWING  SOLUTION  IS  NOT  OPTIMAL. 

1  '  NODE  LIMIT  EXCEEDED.') 


a  o  o 


750  CONTINUE 

CALL  CPTIME ( TOTCP2 , VIRCP2 ) 

T0TCP=T0TCP2-T0TCP1 

VIRCP=VIRCP2-VIRCP1 

Z1=0 

DO  790  1=1, NUMXY 

IF  ( TRANS ( I) .EQ.O)  GO  TO  780 
IF  (XBEST( I) .EQ.O)  GO  TO  755 
XBEST { I ) =0 
GO  TO  790 
755  XBEST ( I ) =1 

780  IF  (XBEST(I) .EQ.O)  GO  TO  790 

Z1=Z1+CJ1(I) 

790  CONTINUE 

C  *  *  *PRINT  OUT  SOLUTION*** 

WRITE ( 6,910)  Z1 

910  FORMAT ( '  THE  BEST  SOLUTION  IS', 18) 

WRITE ( 6,911) 

911  FORMAT ('  THE  VALUE  OF  THE  VARIABLES  AT  ', 

1  'OPTIMALITY  IS') 

DO  800  1=1, NUMXY 

WRITE (6,912)  I , XBEST ( I ) 

800  CONTINUE 

912  FORMAT ( '  VARIABLE  ',13,'  HAS  VALUE  ’,12) 

GO  TO  950 

999  WRITE (6,913) 

913  FORMAT {'  THE  DRAGON  GOT  US  LORD  OSCAR') 

WRITE (6, 976)  NODE,BSTNOD 

976  FORMAT ( '  NODES  IN  CONTROLLING  TREE  ',15,'  BEST  ', 
1  'NODE  ' ,15) 

DEN=FLOAT ( ACOUNT ) /FLOAT ( ASIZE ) 

BIDEN=FLOAT ( BICNT ) /FLOAT ( BISIZE ) 

WRITE  (6,980)  DEN,BIDEN 

980  FORMAT ( '  DENSITY  OF  A  MATRIX  =  ',F7.4,'  DENSITY  ' 
1  ' OF  PROB  SOLVED  BY  ALGOR  =  1 , F7 . 4 ) 

1000  WRITE  (6,957)  TOTCP.VIRCP 
957  F0RMAT(1 HO, 'TOTAL  CPTIME  =', 16 , 3X, ' VIRTUAL  ', 

1  'CPTIME  =' ,16) 

STOP 
END 

SUBROUTINE  BIFEAS ( XFIX , Z2BEST , YBEST , B , A , CJ2 , COL , 

1  ROWNO S, BIG, NUMXY, M,NUMX,NUMY) 

*****PURPOSE 

THIS  SUBROUTINES  FIXES  EACH  VARIABLE  CONTROLLED 
BY  THE  LEADER  AND  CALLS  THE  BALAS  ADDITIVE 
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ALGORITHM.  IF  THE  ALGORITHM  RETURNS  A  SOLUTION, 
THIS  SOLUTION  IS  A  FEASIBLE  SOLUTION  OF  THE  0-1 
BLPP. 

IMPLICIT  INTEGER  (A-Z) 

DIMENSION  XFIX(IOO) , COL (200) ,R0WN0S(800) ,B(100) 
DIMENSION  A( 300) ,CJ2(200) ,BI(2) ,YBEST(200) 

DO  100  1=1 ,  NUMX 
XFIX( I ) =1 

IF  (YBEST(I) .EQ.O)  XFIX(I)=-I 
100  CONTINUE 
B( 1 ) =9999 
B( 2 ) =0 
BIFLG=0 
XFEAS=1 
Z2BEST=-9999 

CALL  BALAS ( XFIX , XFEAS , BIFLG , YBEST , Z2BEST , 

1  B , A , C J2 , COL , ROWNOS , BIG , NUMXY , 

2  M ,  NUMX ,  NUMY ) 

RETURN 

END 

SUBROUTINE  BALAS ( XFIX. XFEAS , BIFLG , YBEST , Z2BEST , 

1  B, A, C2, COL, ROWNOS, BIG, NUMXY, 

2  M, NUMX, NUMY) 


*  *  *  *  * PURPOSE 

THIS  IS  A  FORTRAN  VERSION  OF  THE  BALAS  ADDITIVE 
ALGORITHM  FOR  PURE  0-1  INTEGER  PROGRAMMING.  IT  IS 
BASED  ON  CODES  DEVELOPED  BY  DR.  PAUL  A.  JENSEN. 

IT  IS  USED  TO  SOLVE  THE  0-1  INTEGER  PROGRAMMING 
PROBLEM  DERIVED  FROM  THE  0-1  BLPP. 

IMPLICIT  INTEGER  (A-Z) 

DIMENSION  XFIX(IOO) ,C0L(200) 

DIMENSION  ROWNOS (800) ,B(100) ,A(800) ,C2(200) 
DIMENSION  W( 200 ) ,V(200) ,S{200) ,RHS(100) ,DRHS(100) 
DIMENSION  YFEAS ( 200 ) ,Y(200) ,T(100) ,YBEST(200) 

DO  1  1=1, NUMXY 
YBEST ( I ) =0 
1  CONTINUE 
KL=0 

CALL  SETUP ( FEAS , Z2FIX1 , Y , W, S , V, COL , 

1  ROWNOS, A, T,RHS,B,M, NUMXY) 

***FIX  THOSE  VARIABLES  SET  IN  OUTER  TREE*** 

DO  3  1=1, NUMX 

IF  (XFIX(I) .EQ.O)  GO  TO  3 
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KL=KL+1 

J=I 

V ( KL ) = 1 
YJ=1 

IF  (XFIX(I) .LT.O)  YJ=0 

CALL  SET ( 22FIX1 , KL , W , S , Y , T , RHS , COL , 

1  ROWNOS , A , C2 , FEAS , Y J , J ) 

IF  (FEAS.NE.O)  GO  TO  99 
3  CONTINUE 

C************************ 

C  BEGIN  FATHOM  SECTION* 

Q************************ 

2  CALL  FTEST ( COL , ROWNOS , A , RHS , T , W , V , KL , Y J , FEAS , 
1  NUMXY, Z2FIX1 , S , Y, C2 , J ) 

IF  (FEAS.NE.O)  GO  TO  50 

5  CALL  RELAX( Z2FIX1 , Z2 ) 

IF  (Z2.EQ.BIG)  GO  TO  50 

6  IF  (Z2.LE.Z2BEST)  GO  TO  50 

7  CALL  ROUND ( Z2FEAS , Z2 , RHS , YFEAS , Y , DRHS , 

1  FDUM, BIG, M, NUMXY) 

IF  (Z2FEAS.LE.Z2BEST)  GO  TO  11 

8  Z2BEST=Z2FEAS 
XFEAS=0 

DO  10  1=1, NUMXY 

YBEST ( I ) =YFEAS ( I ) 

10  CONTINUE 

IF  (BIFLG.EQ.l)  GO  TO  99 
IF  (Z2FEAS.EQ.Z2)  GO  TO  50 

11  CALL  CHOOSE (COL, ROWNOS, FDUM, DRHS, A, W,YJ, 

1  BIG, NUMXY, J) 

IF  (J.EQ.O)  GO  TO  50 
KL=KL+1 
V ( KL ) =0 

CALL  SET ( Z2FIX1 , KL , W , S , Y, T , RHS , COL , 

1  ROWNOS, A, C2, FEAS, YJ,J) 

IF  (FEAS.NE.O)  GO  TO  50 

12  GO  TO  2 

£***«*********************** 

C  BEGIN  BACKTRACK  SECTION* 
£*************************** 

50  IF  (KL.EQ.O)  GO  TO  99 
IF  { V ( KL ) . NE . 0 )  GO  TO  80 
J=S ( KL ) 

IF  (W( J) . GT . 0 )  GO  TO  55 
YJ=1 


i 


P 


l 

\ 


o  a 


55  YJ=0 

60  CALL  RESET { KL ,Y,W,V,S,Z2FIX1,T, RHS , COL , 

1  ROWNOS ,  A ,  C  2  , NUMXY ) 

V  { KL )  =  1 

CALL  SET ( Z2FIX1 , KL , W , S , Y , T , RHS , COL , ROWNOS , 

1  A , C2 , FEAS , YJ , J ) 

IF  (FEAS.NE.O)  GO  TO  50 
GO  TO  2 
80  KL=KL-1 
GO  TO  50 
99  RETURN 

£************************** 

C  END  OF  SUBROUTINE  BALAS* 

£**********«*************** 

END 

C 

C  BEGIN  SUBROUTINE  SETUP* 

0************************ 

SUBROUTINE  SETUP ( FEAS , Z2FIX1 , Y , W , S , V , COL , ROWNOS , 
1  A  f  T , RHS , B , M , NUMXY ) 

THIS  SUBROUTINE  INITIALIZES  OR  'SETUP'  VARIABLES 

IMPLICIT  INTEGER  (A-Z) 

DIMENSION  COL ( 200 ) ,ROWNOS(800) ,B( 100) , A(800) 
DIMENSION  W( 200 ) ,V(200) ,S(200) , RHS (100) 

DIMENSION  Y( 200) ,T( 100) 

Z2FIX1=0 

FEAS=0 

DO  100  1=1, M 
RHS ( I ) =B( I ) 

T ( I ) =0 
100  CONTINUE 

DO  110  L=l, NUMXY 
Y ( L ) =0 
W( L ) =0 
S { L ) =0 
V{ L ) =0 

KSTART=COL ( L ) 

KSTOP=COL( L+l ) -1 
DO  120  K=KSTART , KSTOP 
I=ROWNOS { K) 

IF ( A ( K)  . LT  .  0 )  T{ I ) =T ( I ) +A( K) 

120  CONTINUE 
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110  CONTINUE 
RETURN 
END 

0************************ 

C  BEGIN  SUBROUTINE  RELAX* 

Q******* ***************** 

SUBROUTINE  RELAX ( Z2FIX1 , Z2 ) 

IMPLICIT  INTEGER  (A-Z) 

Z2=Z2FIX1 

RETURN 

END 

C  BEGIN  SUBROUTINE  ROUND* 

SUBROUTINE  ROUND ( Z2FEAS , Z2 , RHS , YFEAS , Y , DRHS , 

1  FDUM , BIG ,  M , NUMXY) 

THIS  SUBROUTINE  CHECKS  THE  FEASIBILITY  OF 
A  SOLUTION 

IMPLICIT  INTEGER  (A-Z) 

DIMENSION  RHS( 100) , DRHS (100) 

DIMENSION  YFEAS (200) , Y(200) 

Z2FEAS=Z2 
FDUM=0 

DO  130  1=1, M 

DRHS ( I ) =RHS { I ) 

IF ( DRHS ( I ) . LT . 0 )  FDUM=FDUM-DRHS ( I ) 

130  CONTINUE 

IF  (FDUM.GT.O)  GO  TO  140 
DO  135  I J=1 , NUMXY 
YFEAS ( I J ) =Y ( I J ) 

135  CONTINUE 
RETURN 

140  Z2FEAS=-BIG 
RETURN 
END 

************************* 

BEGIN  SUBROUTINE  CHOOSE* 

************************* 

SUBROUTINE  CHOOSE ( COL , ROWNOS , FDUM , DRHS ,A,W,YJ, 
1  BIG, NUMXY, J) 

THIS  SUBROUTINE  CHOOSES  THE  BEST  FREE  VARIABLE 
AND  SETS  IT  TO  1 

IMPLICIT  INTEGER  (A-Z) 
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DIMENSION  COL (200) , ROWNOS (800) ,A(800) 
DIMENSION  W(200) ,DRHS(100) 

DM-BIG 

J=0 

L=0 

150  L=L+1 

IF  (L.GT.NUMXY)  GO  TO  199 
IF  (W(L).NE.O)  GO  TO  150 
KSTART=COL ( L ) 

KST0P=C0L(L+1 )-l 
INF=FDUM 

DO  160  K=KSTART , KSTOP 
I=ROWNOS(K) 

IDUM=DRHS ( I ) -A { K ) 

IF  ( DRHS ( I ) . LT . 0 )  INF=INF+DRHS ( I ) 

IF  (IDUM.LT.O)  INF=INF-IDUM 
160  CONTINUE 

IF  (DM.LT.INF)  GO  TO  150 

DM=INF 

J=L 

GO  TO  150 

199  IF  (J.EQ.O)  GO  TO  200 
YJ=1 

200  RETURN 
END 

Q********************«* 

C  BEGIN  SUBROUTINE  SET* 

Q********************** 

SUBROUTINE  SET ( Z2FIX1 , KL , W , S , Y , T , RHS , COL , 

1  ROWNOS , A , C2 , FEAS , YJ , J ) 

SUBROUTINE  SET  SETS  VARIABLES  TO  0  OR  1  IF 
BACK  TRACKING 


IMPLICIT  INTEGER  (A-Z) 

DIMENSION  COL (200) , ROWNOS (800) ,A(800) ,C2(200) 
DIMENSION  W( 200 ) , S ( 200 ) , RHS ( 100 ) 

DIMENSION  Y( 200) ,T( 100) 

S ( KL ) = J 

IF  (YJ.EQ.O)  GO  TO  210 
Y( J) -1 
W( J)=KL 

Z2FIX1=Z2FIX1+C2 ( J ) 

GO  TO  220 
210  Y( J ) =0 
W( J)=-KL 


if 


o  o  o 


220  FEAS=0 

KSTART=COL ( J ) 

KST0P=C0L( J+l)-l 
DO  270  K=KSTART , KSTOP 
I=ROWNOS(K) 

IF  (YJ.EQ.I)  RHS { I ) =RHS ( I ) -A ( K ) 

IF  (A(K).LT.O)  T { I ) =T ( I ) -A ( K) 

IF  ( T ( I ) . GT . RHS ( I ) }  FEAS=I 
270  CONTINUE 
280  RETURN 
END 

£************«*******»*** 

C  BEGIN  SUBROUTINE  RESET* 

Q************************ 

SUBROUTINE  RESET ( KL , Y , W, V , S , Z2FIX1 , T , RHS , COL , 

1  ROWNOS , A , C  2 , NUMXY ) 

THIS  SUBROUTINE  FREES  VARIABLES  WHICH  HAVE  BEEN 
SET  AT  LEVELS  HIGHER  THAN  KL 

IMPLICIT  INTEGER  (A-Z) 

DIMENSION  COL (200) , ROWNOS (800) ,A(800) ,C2(200) 
DIMENSION  W{ 200) ,V(200) ,S(200) ,RHS( 100) 
DIMENSION  Y ( 200 ) , T ( 100 ) 

DO  370  L=l, NUMXY 
JL=ABS(W(L) ) 

IF  (JL.LT.KL)  GO  TO  370 
Y(L)=0 
V( JL)=0 
S( JL)=0 

IF  (W(L).GT.O)  Z2FIX1=Z2FIX1-C2(L) 

KSTART=COL ( L ) 

KSTOP=COL ( L+l ) - 1 
DO  360  K=KSTART, KSTOP 
I=ROWNOS(K) 

IF  (W(L).GT.O)  RHS ( I ) =RHS ( I ) +A ( K ) 

IF  (A(K).LT.O)  T  ( I )  =T  ( I )  +A(  K ) 

360  CONTINUE 
W( L ) =0 
370  CONTINUE 
RETURN 
END 


o  o 


0************************ 

C  BEGIN  SUBROUTINE  FTEST* 

SUBROUTINE  FTEST ( COL , ROWNOS , A , RHS , T , W , V , KL , Y J , 

1  FEAS , NUMXY , Z2FIX1 , S , Y , C2 , J ) 

THIS  SUBROUTINE  CHECKS  FEASIBILITY  CONDITIONS  TO 
SET  VARIABLES 
IMPLICIT  INTEGER  (A-Z) 

DIMENSION  COL (200) , ROWNOS (800) ,A(800) ,C2(200) 
DIMENSION  W( 200 ) ,V(200) , RHS ( 100) , S(200) 

DIMENSION  T( 100) , Y( 200) 

DO  470  I J=1 , NUMXY 

IF  (W(IJ).NE.O)  GO  TO  470 
KSTART=COL ( I J ) 

KSTOP=COL ( I J+l ) -1 
DO  420  K=KSTART , KSTOP 
I -ROWNOS ( K) 

IF  (A(K).EQ.O)  GO  TO  420 
IF  (A(K) .LT.O)  GO  TO  410 
IF  ( (RHS(I)-A(K) ) .GE.T(I) )  GO  TO  420 
KL=KL+1 
V ( KL ) = 1 
J=IJ 
YJ=0 

GO  TO  415 

410  IF  (RHS(I) .GE. (T(I)-A(K) ) )  GO  TO  420 

KL=KL+1 
V ( KL ) = 1 
J  =  IJ 
YJ=1 

415  CALL  SET(Z2FIX1 ,KL,W,S, Y,T, RHS, COL, ROWNOS, A, 

1  C2 , FEAS , YJ , J ) 

IF  (FEAS.NE.O)  GO  TO  480 
GO  TO  470 
420  CONTINUE 

470  CONTINUE 
480  RETURN 
END 


I 


A. 4  XMP  Variable  Definitions 

The  algorithms  which  solve  the  BLPP  and  the  mixed 
integer  BLPP  rely  on  the  XMP  library  of  linear 
programming  subroutines  (Marsten  1981).  Because  of 
this,  many  of  the  variables  used  in  the  two  algorithms 
are  variables  required  by  XMP.  In  this  section,  the  XMP 
variables  used  in  the  two  algorithms  are  defined. 
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** ‘DICTIONARY  OF  XMP  VARIABLES*  *  * 


B  IS  THE  RIGHT-HAND  SIDE  ARRAY. 

BASCB  IS  AN  ARRAY  CONTAINING  THE  OBJECTIVE 

FUNCTION  COEFFICIENTS  OF  THE  BASIC 
VARIABLES . 

BASIS  IS  THE  LIST  OF  BASIC  VARIABLES. 

BASLB  IS  AN  ARRAY  CONTAINING  THE  LOWER  BOUNDS 
ON  THE  BASIC  VARIABLES. 

BASUB  IS  AN  ARRAY  CONTAINING  THE  UPPER  BOUNDS 
ON  THE  BASIC  VARIABLES. 

BLOW  CONTAINS  THE  LOWER  LIMIT  FOR  EACH 

TWO-SIDED  CONSTRAINT.  (UPPER  LIMIT 
IS  IN  B) . 

BNDTYP  1  MEANS  LOWER  B0UND=0 ,  UPPER 

BOUND=+ INFINITY  FOR  EVERY  NON-FREE 
VARIABLE ; 

2  MEANS  LOWER  B0UND=0 ,  UPPER  BOUND=BOUND 
FOR  EVERY  NON-FREE  STRUCTURAL  VARIABLE 

3  MEANS  LOWER  BOUND=0  FOR  EVERY  NON-FREE 
VARIABLE ; 

4  MEANS  BOTH  BOUNDS  ARE  GENERAL. 

BOUND  IS  THE  COMMON  UPPER  BOUND  WHEN  BNDTYP=2 . 

CAND  IS  THE  CANDIDATE  LIST;  IT  CONTAINS  THE 

NON-BASIC  VARIABLES  THAT  ARE  ELIGIBLE  TO 
ENTER  THE  BASIS  DURING  A  SERIES  OF  MINOR 
ITERATIONS . 

CANDA  IS  A  TABLE  CONTAINING  THE  NON-ZERO 

COEFFICIENTS  OF  THE  COLUMNS  THAT  BELONG 
TO  THE  CANDIDATE  LIST. 

CANDCJ  IS  A  LIST  CONTAINING  THE  OBJECTIVE 

FUNCTION  COEFFICIENT  FOR  EACH  COLUMN 
THAT  BELONGS  TO  THE  CANDIDATE  LIST. 

CAND I  IS  A  TABLE  CONTAINING  THE  ROW  NUMBERS 

CORRESPONDING  TO  THE  NON-ZEROS  OF  THE 
COLUMNS  THAT  BELONG  TO  THE  CANDIDATE 
LIST. 

CANDL  IS  A  LIST  CONTAINING  THE  NUMBER  OF 

NON-ZEROS  IN  EACH  COLUMN  THAT  BELONGS 
TO  THE  CANDIDATE  LIST. 

CJ  IS  USED  TO  HOLD  THE  OBJECTIVE  FUNCTION 

COEFFICIENT . 

COLA  IS  USED  TO  HOLD  THE  NON-ZERO  COEFFICIENTS 

OF  A  MATRIX  COLUMN. 


COLI 


COLLEN 


COLMAX 


FACTOR 

IOERR 


IOLOG 


ITER 

ITER1 


ITER2 


LENI 


LENR 


LENMI 


LENMR 


LOOK 


M 

MAPI 

MAPR 

MAXA 


MAXM 


MAXN 


MEM  I 
MEMR 


IS  USED  TO  HOLD  THE  ROW  NUMBERS 
CORRESPONDING  TO  THE  NON-ZEROS  OF  A 
MATRIX  COLUMN. 

IS  USED  TO  HOLD  THE  ROW  NUMBERS 
CORRESPONDING  TO  THE  NON-ZEROS  OF  A 
MATRIX  COLUMN. 

IS  THE  MAXIMUM  NUMBER  OF  NON-ZEROS  IN  ANY 
MATRIX  COLUMN. 

IS  THE  REFACTORIZATION  FREQUENCY. 

IS  THE  I/O  UNIT  WHERE  ERROR  MESSAGES 
ARE  TO  BE  WRITTEN. 

IS  THE  I/O  UNIT  WHERE  LOG  INFORMATION 
IS  TO  BE  WRITTEN,  IF  REQUESTED. 

IS  THE  NUMBER  OF  ITERATIONS  PERFORMED. 
CONTAINS  THE  NUMBER  OF  PHASE  1  ITERATIONS 
PERFORMED . 

CONTAINS  THE  NUMBER  OF  PHASE  2  ITERATIONS 
PERFORMED . 

LENGTH  OF  THE  WORKING  STORAGE  ARRAYS  FOR 
INTEGER  DATA. 

LENGHT  OF  THE  WORKING  STORAGE  ARRAYS  FOR 
REAL  DATA. 

LENGTH  OF  THE  MAP  OF  THE  WORKING  STORAGE 
ARRAY  FOR  INTEGER  DATA. 

LENGTH  OF  THE  MAP  OF  THE  WORKING  STORAGE 
ARRAY  FOR  REAL  DATA. 

IS  USED  TO  HOLD  THE  LOWER  BOUND  ON 
A  SINGLE  VARIABLE. 

IS  THE  NUMBER  OF  MATRIX  COLUMNS  TO  BE 
CONSIDERED  DURING  CONSTRUCTION  OF  THE 
CANDIDATE  LIST. 

IS  THE  NUMBER  OF  CONSTRAINTS. 

IS  A  MAP  OF  ARRAY  MEMI . 

IS  A  MAP  OF  ARRAY  MEMR. 

IS  THE  MAXIMUM  NUMBER  OF  NON-ZEROS  THAT 
WILL  BE  ENCOUNTERED  IN  THE  CONSTRAINT 
MATRIX  DURING  THE  CURRENT  RUN. 

IS  THE  MAXIMUM  NUMBER  OF  CONSTRAINTS  THAT 
WILL  BE  ENCOUNTERED  DURING  THE  CURRENT 
RUN;  IT  IS  USED  TO  SET  ARRAY  SIZES. 

IS  THE  MAXIMUM  NUMBER  OF  VARIABLES  THAT 
WILL  BE  ENCOUNTERED  DURING  THE  CURRENT 
RUN;  IT  IS  USED  TO  SET  ARRAY  SIZES. 

ARRAY  CONTAINING  HIDDEN  INTEGER  DATA. 
ARRAY  CONTAINING  HIDDEN  REAL  DATA. 
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NTYPE2 


PICK 

PRINT 


ROWTYP 


SCODE 


STATUS 
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IS  THE  NUMBER  OF  VARIABLES  (TOTAL, 
INCLUDING  SLACKS  AND  ARTIFICIALS). 

IF  BNDTYP=2 ,  THEN  EACH  VARIABLE 

1,2 . NTYPE2  MUST  EITHER  SHARE  THE 

COMMON  UPPER  BOUND  OR  ELSE  BE  A  FREE 
VARIABLE.  EACH  OF  THE  REMAINING 
VARIABLES  NTYPE2+1 , . . . , N  MUST  EITHER 
HAVE  LOWER  BOUND  ZERO  AND  UPPER  BOUND 
♦INFINITY  OR  ELSE  BE  A  FREE  VARIABLE. 

IS  THE  SIZE  OF  THE  CANDIDATE  LIST  USED 
FOR  MULTIPLE  PRICING. 

SPECIFIES  THE  LEVEL  OF  PRINTING  DESIRED: 

0  MEANS  ERROR  MESSAGES  ONLY; 

1  MEANS  TERMINATION  CONDITION  MESSAGES; 

2  MEANS  PRINT  OBJECTIVE  FUNCTION  VALUE 
AFTER  EACH  BASIS  RE-FACTORIZATION; 

3  MEANS  LOG  INFORMATION  AT  EVERY 
ITERATION. 

IS  THE  ARRAY  OF  ROW  TYPES: 

+2  MEANS  A  TWO-SIDED  CONSTRAINT; 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO; 

-2  MEANS  A  FREE  ROW  (FUNCTIONAL). 

IS  A  RETURN  CODE  FOR  XSTART : 

1  MEANS  EVERYTHING  OK; 

2  MEANS  THE  GIVEN  BASIS  WAS  SINGULAR. 

AN  INDICATOR  FOR  EACH  VARIABLE: 

0  MEANS  THE  VARIABLE  IS  OUT  AT  ITS 
LOWER  BOUND; 

K  MEANS  THAT  THIS  IS  THE  K-TH  BASIC 
VARIABLE ; 

-1  MEANS  THAT  THIS  VARIABLE  IS  OUT  AT  ITS 
UPPER  BOUND; 

-2  MEANS  THAT  THIS  IS  A  FREE  VARIABLE... 

ONCE  IN  THE  BASIS  IT  NEVER  LEAVES; 

-3  MEANS  THAT  THIS  IS  AN  ARTIFICIAL 

VARIABLE. . .ONCE  IT  LEAVES  THE  BASIS  IT 
NEVER  RE-ENTERS. 

-4  MEANS  THE  VARIABLE  IS  LOCKED  OUT  OF 
THE  BASIS  AT  ITS  LOWER  BOUND; 

-5  MEANS  THE  VARIABLE  IS  LOCKED  OUT  OF 
THE  BASIS  AT  ITS  UPPER  BOUND. 

NOTE:  FREE  AND  ARTIFICIAL  VARIABLES 
ALWAYS  HAVE  STATUS  -2  OR  -3  RESPECTIVELY, 
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C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 
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TERMIN 


UJ 

UNBDDQ 


UZERO 

XBZERO 


YQ 

Z 


THEY  DO  NOT  GET  A  POSITIVE  STATUS  WHEN 
THEY  ARE  IN  THE  BASIS. 

NOTE:  SUPER-BASIC  VARIABLES  HAVE  POSITIVE 
STATUS  GREATER  THAN  M. 

IS  THE  TERMINATION  CODE  FOR  THE  PRIMAL 
SIMPLEX  METHOD: 

1  MEANS  OPTIMAL  SOLUTION  FOUND; 

2  MEANS  PROBLEM  IS  UNBOUNDED; 

3  MEANS  THE  PROBLEM  IS  INFEASIBLE; 

4  MEANS  THE  PRESUMED  OPTIMAL  SOLUTION 
DOES  NOT  SATISFY  THE  ACCURACY  CHECK; 

5  MEANS  THE  PROBLEM  HAS  BEEN  ABANDONED. 

IS  USED  TO  HOLD  THE  UPPER  BOUND  ON  A 
SINGLE  VARIABLE. 

IF  THE  PROBLEM  IS  UNBOUNDED,  THEN  UNBDDQ 
IS  INDEX  OF  THE  VARIABLE  THAT  WAS  ABOUT 
TO  ENTER  THE  BASIS  WHEN  THE  UNBOUNDED 
CONDITION  WAS  DETECTED. 

THE  ARRAY  CONTAINING  THE  VALUES  OF  THE 
DUAL  VARIABLES. 

THE  ARRAY  CONTAINING  THE  VALUES  OF  THE 
BASIC  VARIABLES  AND  THE  SUPER-BASIC 
VARIABLES . 

IS  USED  TO  HOLD  THE  UNPACKED  COLUMN  THAT 
IS  ABOUT  TO  ENTER  THE  BASIS. 

IS  THE  VALUE  OF  THE  OBJECTIVE  FUNCTION. 


a 


a 


A. 5  Programs  for  the  BLPP 


Three  programs  were  created  to  support  the 
algorithm  for  the  BLPP.  As  with  the  0-1  BLPP  algorithm, 
the  three  programs  create  randomly  generated  BLPPs , 
allow  the  input  of  a  BLPP,  and  solve  the  BLPP. 

A . 5 . 1  Program  for  Creating  Randomly  Generated  BLPPs 
The  following  program  creates  randomly  generated 
BLPPs.  The  program  calls  the  function  URAND  which 
returns  randomly  generated  numbers .  URAND  is  presented 
in  section  A. 3.  The  randomly  generated  problem  is 
output  in  its  equivalent  Kuhn-Tucker  formulation.  The 
program  requires  seven  inputs.  They  are 

the  number  of  variables  controlled  by  the  leader; 
the  number  of  variables  controlled  by  the  follower; 
the  number  of  constraints  with  no  variables 
controlled  by  the  follower; 
the  maximum  number  of  vertices  allowed  in  the 
branch  and  bound  tree; 

the  maximum  number  of  nonzero  elements  in  a  column 
of  the  A  or  B  matrix; 
the  random  number  seed. 

The  program  contains  variable  definitions  and 
documentation . 
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PROGRAM  MATGEN 
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*****PURPOSE 

PROGRAM  GENERATES  RANDOM  BILEVEL  LINEAR 
PROGRAMMING  PROBLEMS  (BLPP).  THE  FUNCTION  URAND 
PROVIDES  RANDOM  NUMBERS.  REFER  TO  THE  SECTION  ON 
THE  FUNCTION  URAND  FOR  MORE  INFORMATION  AND  A 
LISTING  OF  THE  FUNCTION. 


♦♦♦VARIABLE  DEFINITIONS*  *  * 


ACC 


B 

BNDTYP 


CJ1 

CJ2 

COLA 

COLI 


COLLEN 

CONX 

CONY 

CRITV 


IY 


ARRAY  WHICH  CONTAINS  THE  COEFFICIENTS  OF 
EACH  VARIABLE  IN  THE  A-  AND  B-MATRIX  OF 
OF  THE  BLPP. 

THE  RIGHT  HAND  SIDE  ARRAY. 

1  MEANS  LOWER  BOUND=0,  UPPER 
BOUND=+ INFINITY 

FOR  EVERY  NON-FREE  VARIABLE; 

2  MEANS  LOWER  BOUND=0 ,  UPPER  BOUND=BOUND 
FOR  EVERY  NON-FREE  STRUCTURAL  VARIABLE 

3  MEANS  LOWER  B0UND=0  FOR  EVERY  NON-FREE 
VARIABLE ; 

4  MEANS  BOTH  BOUNDS  ARE  GENERAL. 

ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

IS  USED  TO  HOLD  THE  NON-ZERO  COEFFICIENTS 
OF  A  MATRIX  COLUMN. 

IS  USED  TO  HOLD  THE  ROW  NUMBERS 
CORRESPONDING  TO  THE  NON-ZEROS  OF  A  MATRIX 
COLUMN . 

THE  NUMBER  OF  NONZEROS  IN  EACH  COLUMN  OF 
THE  A-  AND  B-MATRIX  OF  THE  BLPP. 

NUMBER  OF  CONSTRAINTS  CONTAINING  NO 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER. 

NUMBER  OF  COMPLEMENTARY  SLACKNESS 
CONDITIONS  WHICH  MUST  BE  SATISFIED  IN 
SOLVING  THE  BLPP  IN  ITS  EQUIVALENT  KUHN- 
TUCKER  REPRESENTATION. 

RANDOM  NUMBER  SEED  OF  IY. 


MAXCOL 


MINMAX 


NSTRUC 

NUMCON 

NUMITR 


NUMX 

NUMXY 

NUMY 

ROWTYP 


IS  USED  TO  HOLD  THE  LOWER  BOUND  ON  A 
SINGLE  VARIABLE. 

NUMBER  OF  CONSTRAINTS  IN  THE  EQUIVALENT 
KUHN-TUCKER  REPRESENTATION  OF  THE  BLPP . 
MAXIMUM  NUMBER  OF  NONZEROS  IN  ANY  ONE 
COLUMN  OF  THE  BLPP. 

FLAG  INDICATING  NATURE  OF  THE  PROBLEM. 

1  MEANS  MAXIMIZATION;  -1  MEANS 
MINIMIZATION.  FIXED  AT  1  IN  THIS  PROGRAM. 
NUMBER  OF  VARIABLES  IN  THE  KUHN-TUCKER 
REPRESENTATION  OF  THE  BLPP. 

THE  NUMBER  OF  CONSTRAINTS  IN  THE  BLPP. 

THE  MAXIMUM  NUMBER  OF  VERTICES  IN  THE 
BRANCH  AND  BOUND  TREE  CREATED  WHEN  SOLVING 
THE  BLPP. 

THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER . 

THE  NUMBER  OF  VARIABLES  IN  THE  BLPP. 

THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER. 

ARRAY  WHICH  INDICATES  THE  TYPE  OF 
CONSTRAINT : 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 

IS  USED  TO  HOLD  THE  UPPER  BOUND  ON  A 
SINGLE  VARIABLE. 

ARRAY  CONTAINS  VALUES  USED  TO  CREATE  THE 
KUHN-TUCKER  STATIONARITY  CONDITIONS  OF  THE 
FOLLOWER'S  PROBLEM. 

VARIABLE  DEFINITIONS*** 


***NOTE*** 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 

Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 

U  REFERS  TO  KUHN-TUCKER  MULTIPLIERS  ASSOCIATED 
WITH  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  WITH  THE 
NONNEGATIVE  RESTRICTIONS  ON  THE  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER; 

G  REFERS  TO  THE  SLACK  OR  SURPLUS  VARIABLE 
ASSOCIATED  WITH  EACH  CONSTRAINT  CONTAINING 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

*  *  *  END  OF  NOTE*** 
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REAL  UROW( 200 , 200 ) ,COLA(200) ,B(200) , ACC ( 200 , 200 ) , 

1  CJ1(200) ,CJ2(200) ,UJ,LJ 

INTEGER  CNT , COLI { 200 ) ,C0LLEN(200) , CONY , CONX , CONXY , 
1  CRITV , PRINT , ECHO , BNDTYP , ROWTYP ( 200 ) 

CHARACTER* 4  DUMY 
A0NE=1 .0 
IONE=l 
ZER0=0 . 0 
IZER0=0 
DUMY= ' XSUB 

READ  (5,*)  NUMX,NUMY, CONX, CONY, NUMITR , MAXCOL , IY 
MINMAX=1 
ECH0=0 
PRINT=0 
BNDTYP=4 
UJ=200000.0 
LJ=0  -  0 

NUMXY=NUMX+NUMY 
CRITV=NUMY+CONY 
M=NUMY+CONY+CONX 
NSTRUC=NUMY+NUMY+CONY+CONY+NUMX 
C0NX1=C0NX+1 
NUMX 1 =NUMX+ 1 
C0NXY=C0NX+C0NY 

♦♦♦COMPUTE  RHS  OF  CONSTRAINTS  WITH  NO  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  CONSTRAINTS 
WITH  VARIABLES  CONTROLLED  BY  THE  FOLLOWER*** 

DO  100  1=1, CONXY 
ROWTYP ( I ) = 1 
DUMMY=URAND( IY) 

IF  (DUMMY.LT. 0.3)  ROWTYP ( I ) =- 1 
B ( I ) =DUMMY*  50 . 0 
100  CONTINUE 

** ‘COMPUTE  COEFFICIENTS  OF  LEADER  AND  FOLLOWER 
OBJECTIVE  FUNCTIONS*** 

DO  120  1=1 , NUMXY 

C J 1 ( I ) =URAND ( I Y ) *40.0-20.0 
CJ2 ( I ) =URAND ( IY) *40.0-20.0 
120  CONTINUE 

MAXC2=MAXC0L+MAXC0L 
C  *  *  *GENERATE  THE  A-  AND  B-MATRICES  OF  BLPP*** 

DO  130  1=1, NUMXY 
IROW=0 
CNT=0 

IF  (I.GE.NUMX1)  IROW=CONX 
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DO  140  J  =  1 , MAXC  2 , 2 

YA=URAND ( IY) *60.0-15.0 
R0WNUM=URAND( IY) *3 .7+1 .0 
I ROW=ROWNUM+ I ROW 
IF { IROW . GT . CONXY )  GO  TO  145 
ACC ( I , J ) =IR0W 
ACC { I , J+l ) =YA 
UROW ( I , IROW ) =YA 
CNT=CNT+1 
140  CONTINUE 

145  COLLEN ( I ) =CNT 

130  CONTINUE 

C  ***WRITE  PROBLEM  INFORMATION  CONSTANTS*** 

WRITE  (6,905)  CRITV , NUMX , NUMY , CONX , CONY, NUMITR 
905  FORMAT  (615) 

WRITE  (6,908)  M , NSTRUC , MINMAX , ECHO , PRINT , BNDTYP 
908  FORMAT (615) 

C  ***WRITED  ROWTYP  AND  RHS  OF  CONSTRAINTS*** 

DO  150  1=1, CONX 

WRITE  (6,910)  I , ROWTYP ( I ) , B ( I ) 

150  CONTINUE 

DO  151  I=C0NX1 , CONXY 

WRITE  (6,910)  I , IZERO , B ( I ) 

151  CONTINUE 

910  FORMAT ( 215, F13. 3) 

C  ***WRITE  ROWTYP  AND  RHS  OF  U-ROWS*** 

DO  160  1=1, NUMY 
K=I+CONXY 
J=I+NUMX 

WRITE  (6,910)  K, IZERO, -CJ2(J) 

160  CONTINUE 

C  ***WRITE  X  VARIABLE  INFO  AND  COLUMNS*** 

DO  230  1=1, NUMX 
ICOLL=COLLEN( I) 

WRITE  (6,915)  DUMY , I , ICOLL , CJ1 ( I ) , UJ , LJ , IZERO 
ICOLL2  =  2  * ICOLL 
DO  235  J=1 , IC0LL2 , 2 
IB=ACC { I , J ) 

234  WRITE  (6,920)  IB , ACC ( I , J+l ) 

235  CONTINUE 
230  CONTINUE 

915  FORMAT (A4 ,2I5,F15.5,2F10.0,I2) 

920  FORMAT ( I 5 , F 1 5 . 5 ) 

C  *  *  *WRITE  Y  VARIABLE  INFO  AND  COLUMNS*** 

DO  170  I=NUMX1 , NUMXY 
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IC0LL=C0LLEN ( I ) 

ICOLL2=2*ICOLL 

WHITE  (6,915)  DUMY , I , ICOLL , CJ 1(1), UJ , LJ , IZERO 
DO  180  J  =  1  , IC0LL2 , 2 
IB=ACC ( I , J ) 

WRITE  (6,920)  IB , ACC ( I , J+l ) 

CONTINUE 

CONTINUE 

***WRITE  G'S  OF  Y  CONSTRAINTS*** 

DO  190  1=1, CONY 
ISEQ=NUMXY+I 

WRITE  (6,915)  DUMY, ISEQ, IONE, ZERO, UJ,LJ, IZERO 
IDUM=I+CONX 

IF  (ROWTYP(IDUM) .EQ.-l)  A0NE=-1.0 
WRITE  (6,920)  IDUM.AONE 
AONE= 1 . 0 
CONTINUE 

***WRITE  THE  U'S  OF  THE  Y  .GE.  0  CONSTRAINTS*** 
DO  200  1=1, NUM Y 

I SEQ=NUMXY+C  ONY + 1 
IROW=I+CONXY 

WRITE  (6,915)  DUMY, ISEQ, IONE, ZERO, UJ,LJ, IZERO 
WRITE  (6,920)  IROW,AONE 
CONTINUE 

***WRITE  THE  U'S  WHICH  ARE  KUHN-TUCKER* *  * 
MULTIPLIERS  OF  Y  CONSTRAINTS  DERIVED 
FROM  EQUATION 

GRAD ( F ( Y ) ) -U*GRAD ( G ( Y ) )=0*** 

DO  210  I=C0NX1 , CONXY 
CNT=0 

DO  215  J=NUMX1 , NUMXY 

IF ( UROW ( J , I ) . EQ . 0 . 0 )  GO  TO  215 
CNT=CNT+1 

COLA ( CNT ) =-UROW ( J , I ) 

IF  (ROWTYP(I) .EQ.-l)  COLA ( CNT ) =UROW( J , I ) 
COLI ( CNT ) = J+CONXY-NUMX 
CONTINUE 

I SEQ= I +CQNY+NUMY+NUMXY-CONX 

WRITE  (6,915)  DUMY, ISEQ, CNT, ZERO, U J , L J , IZERO 
DO  220  K=1 , CNT 

WRITE  (6,920)  COLI ( K) , COLA( K) 

CONTINUE 

CONTINUE 

STOP 

END 


Creates  its  Equivalent  Kuhn-Tucker 
Representation 

The  following  program  has  two  functions.  It  can  be 
used  to  input  the  data  of  a  BLPP  or  a  mixed  integer 
BLPP.  It  then  creates  a  formulation  of  the  data  which 
can  be  used  as  input  to  the  program  which  solves  the 
BLPP  or  mixed  integer  BLPP.  The  instructions  for 
inputting  the  data  are  contained  in  the  program. 
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PROGRAM  BLPPRD 
C 

c  **** ‘PURPOSE 

C  THIS  PROGRAM  READS  IN  A  BILEVEL  PROGRAMMING 

C  PROBLEM  { BLPP )  OR  A  MIXED  INTEGER  BLPP  AND  CREATES 

C  THE  MATHEMATICAL  PROGRAMMING  PROBLEM  WHICH  CAN  BE 

C  SOLVED  USING  THE  ALGORITHMS  PRESENTED  IN  CHAPTER  5 

C  (BLPP)  OR  CHAPTER  6  (MIXED  INTEGER  BLPP)  TO  SOLVE 

C  THE  PROBLEM. 

C 

c  *****DIRECTIONS***** 

C  TO  CREATE  A  REPRESENTATION  OF  THE  BLPP  OR  MIXED 

C  INTEGER  BLPP  WHICH  CAN  BE  SOLVED  BY  THE 

C  APPROPRIATE  ALGORITHM,  ENTER  THE  DATA  OF  THE  BLPP 

C  OR  MIXED  INTEGER  BLPP  AS  OUTLINED  BELOW. 

C 

C  THE  CONSTRAINTS  MUST  BE  IN  A  CERTAIN  ORDER. 

C  EXAMINE  THE  CONSTRAINTS  AND  PUT  THOSE  WHICH  HAVE 

C  NO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER  BEFORE 

C  THOSE  WHICH  DO. 

C 

C  THE  VARIABLES  MUST  ALSO  BE  PLACED  IN  A  SPECIFIC 

C  ORDER.  THE  VARIABLES  CONTROLLED  BY  THE  LEADER 

C  MUST  PRECEDE  THOSE  CONTROLLED  BY  THE  FOLLOWER. 

C 

C  ALL  DATA  IS  INPUT  USING  FREE  FORMAT.  THIS  MEANS 

C  DATA  ON  A  CARD  ARE  SEPARATED  BY  COMMAS  OR  SPACES. 

C  EACH  "CARD"  OR  LINE  OF  DATA  REPRESENTS  AN  INPUT 

C  FIELD. 

C 

C  THE  FIRST  LINE  OF  DATA  HAS  FOUR  ENTRIES 

C  THE  FOUR  INTEGER  ELEMENTS  ENTERED  ARE: 


c 

c 

ENTRY 

1  : 

PROBLEM  TYPE:  +1  MEANS  MAXIMIZE ;-l 

MEANS  MINIMIZE; 

c 

c 

ENTRY 

2  : 

INPUT  DATA  ECHO:  1  MEANS  ECHO  DATA; 

0  MEANS  NO  ECHO; 

c 

c 

c 

ENTRY 

3  : 

XMP  PRINT  SPECIFICATION.  0  IS  BEST. 

SEE  THE  XMP  DICTIONARY  FOR  A  DEFINITION 
OF  THE  VARIOUS  PRINT  OPTIONS; 

c 

ENTRY 

4  : 

1— ALL  VARIABLES  REAL  VALUED; 

C  2 — SOME  VARIABLES  ARE  INTEGER. 

C 

C  THE  NEXT  LINE  OF  DATA  GIVES  THE  BASICS  OF  THE 

C  PROBLEM.  ALL  ENTRIES  ARE  INTEGER. 

C  ENTRY  1 :  NUMBER  OF  CONSTRAINTS  WITHOUT  VARIABLES 
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c 

C  ENTRY  2 : 

C 

C  ENTRY  3 : 

C 

C  ENTRY  4 : 

C 

C  ENTRY  5 : 

C 
C 

C  ENTER  THE  COEFFICIENT  OF  EACH  VARIABLE  IN  THE 

C  LEADER'S  OBJECTIVE  FUNCTION.  EACH  COEFFICIENT 

C  GOES  ON  ONE  LINE  OF  DATA,  I.E.  ONE  ENTRY  PER  LINE. 

C  IF  A  VARIABLE'S  COEFFICIENT  IS  ZERO,  ENTER  O.O. 

C  ENTRY  1:  THE  COEFFICIENT  OF  EACH  VARIABLE  IN  THE 

C  LEADER'S  OBJECTIVE  FUNCTION. 

C 

C  ENTER  THE  COEFFICIENTS  OF  THE  LINEAR  TERMS  IN  THE 

C  FOLLOWER'S  OBJECTIVE  FUNCTION.  ONLY  ENTER  THE 

C  COEFFICIENT  OF  THOSE  VARIABLES  CONTROLLED  BY  THE 

C  FOLLOWER.  AGAIN,  THERE  IS  ONLY  ONE  ENTRY  PER 

C  LINE  IF  A  VARIABLE  CONTROLLED  BY  THE  FOLLOWER  HAS 

C  A  ZERO  COEFFICIENT  IN  THE  FOLLOWER'S  OBJECTIVE 

C  FUNCTION  ENTER  0.0  FOR  THAT  VARIABLE. 

C  ENTRY  1:  THE  COEFFICIENT  OF  EACH  VARIABLE 

C  CONTROLLED  BY  THE  FOLLOWER  IN  THE 

C  FOLLOWER'S  OBJECTIVE  FUNCTION. 

C 

C  ENTER  INFORMATION  ON  EACH  CONSTRAINT.  THE 

C  INFORMATION  IS  CONSTRAINT  NUMBER,  CONSTRAINT  TYPE, 

C  AND  THE  RIGHT-HAND-SIDE.  THE  CONSTRAINT  TYPES  ARE 

C  AS  FOLLOWS : 

C 

C  +1 — LESS  THAN  OR  EQUAL  CONSTRAINT; 

C  0— EQUALITY  CONSTRAINT; 

C  -1 — GREATER  THAN  OR  EQUAL  CONSTRAINT. 

C 

C  THE  RIGHT-HAND  SIDE  ENTRY  MUST  BE  POSITIVE. 

C  THE  FIRST  TWO  ENTRIES  ARE  INTEGER  AND  THE  THIRD 

C  IS  REAL.  THERE  IS  ONE  LINE  OF  DATA  PER 

C  CONSTRAINT. 

C 

C  ENTRY  1:  ENTER  THE  CONSTRAINT  NUMBER; 

C  ENTRY  2:  ENTER  THE  CONSTRAINT  TYPE 

C  (EITHER  -1,0,  OR  +1) ; 


CONTROLLED  BY  THE  FOLLOWER; 

NUMBER  OF  CONSTRAINTS  WITH  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER. 

NUMBER  OF  VARIABLES  CONTROLLED  BY 
THE  LEADER; 

NUMBER  OF  VARIABLES  CONTROLLED  BY 
THE  FOLLOWER; 

MAXIMUM  NUMBER  OF  VERTICES  ALLOWED 
IN  THE  BRANCH  AND  BOUND  TREE. 
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ENTRY  3:  ENTER  THE  RIGHT-HAND-SIDE  OF  THE 
CONSTRAINT (>0) . 

ENTER  THE  INFORMATION  ON  EACH  VARIABLE. 
INFORMATION  ABOUT  THE  VARIABLES  CONTROLLED  BY  THE 
LEADER  IS  ENTERED  FIRST.  INFORMATION  ABOUT 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER  IS  ENTERED 
AFTER  THE  INFORMATION  ON  THE  VARIABLES  CONTROLLED 
BY  THE  LEADER.  ENTER  ALL  DATA  ON  A  VARIABLE 
BEFORE  PROCEEDING  TO  THE  NEXT  VARIABLE.  A  LINE 
OF  DATA  ON  EACH  VARIABLE  CONTAINS  GENERAL 
INFORMATION  ABOUT  THAT  VARIABLE.  THE  THREE 
ENTRIES  ARE  INTEGER  WHERE: 


ENTRY  1 : 
ENTRY  2: 

ENTRY  3: 


THE  VARIABLE  NUMBER; 

NUMBER  OF  NON-ZERO  COEFFICIENTS  IN  THE  A 
OR  B  MATRIX; 

VARIABLE  TYPE  WHERE  THE  TYPES  ARE  AS 
FOLLOWS : 

0— A  REAL  VALUED,  UNBOUNDED  VARIABLE; 

1—  AN  INTEGER,  UNBOUNDED  VARIABLE; 

2 —  AN  UPPER  BOUNDED,  INTEGER  VARIABLE; 

3—  AN  UPPER  BOUNDED,  REAL  VALUED 
VARIABLE . 


IF  A  VARIABLE  HAS  AN  UPPER  BOUND,  THE  NEXT  LINE  OF 
DATA  IS  THE  UPPER  BOUND.  IF  THE  VARIABLE  IS  NOT 
UPPER  BOUNDED,  THE  UPPER  BOUND  IS  SET  TO  200,000. 
THE  LOWER  BOUND  ON  ALL  VARIABLES  IS  SET  TO  0.0. 

ENTER  THE  VARIABLE'S  NON-ZERO  COEFFICIENTS  IN  THE 
A  OR  B  MATRIX.  TO  ENTER  THIS  INFORMATION,  TWO 
DATA  ENTRIES  PER  LINE  ARE  MADE.  THE  FIRST  ENTRY 
IS  INTEGER  AND  THE  SECOND  IS  REAL. 

ENTRY  1:  THE  ROW  NUMBER  (CONSTRAINT)  IN  WHICH  THE 
COEFFICIENT  APPEARS; 

ENTRY  2:  THE  COEFFICIENT. 

AFTER  ALL  NON-ZERO  COEFFICIENTS  OF  A  VARIABLE  HAVE 
BEEN  ENTERED,  GO  TO  THE  NEXT  VARIABLE  AND  ENTER 
INFORMATION  FOR  IT. 

IF  THE  PROBLEM  HAS  NONLINEAR  TERMS  IN  THE 
FOLLOWER'S  OBJECTIVE  FUNCTION,  THIS  INFORMATION 
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IS  NOW  ENTERED 


THE  LAST  INFORMATION  ENTERED  IS  THE  COEFFICIENTS 
OF  THE  NONLINEAR  TERMS,  IF  AN 7 ,  IN  THE  FOLLOWER'S 
OBJECTIVE  FUNCTION.  A  WAY  TO  REPRESENT  THIS  DATA 
IS  THE  FOLLOWING  FORM: 

T 

(X, Y)  Q  ( X , Y )  WHERE  Q  IS  A  LOWER  TRIANGULAR 
MATRIX  AND  THE  T  MEANS  THE  TRANSPOSE  OF  THE  ROW 
VECTOR  (X, Y)  WHERE  X  REPRESENTS  THE  VARIABLES 
CONTROLLED  BY  THE  LEADER  AND  Y  REPRESENTS  THE 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER.  THIS  ALLOWS 
THE  REPRESENTATION  OF  EVERY  POSSIBLE  CROSS  PRODUCT 
OF  THE  PROBLEM  VARIABLES.  THE  ELEMENTS  OF  Q 
CORRESPOND  TO  THE  COEFFICIENTS  OF  THESE  TERMS  IN 
THE  FOLLOWER'S  OBJECTIVE  FUNCTION.  FOR  INSTANCE, 
THE  ROW  1,  COLUMN  1  ELEMENT  OF  Q  IS  THE 
COEFFICIENT  OF  THE  PRODUCT  OF  VARIABLE  ONE  WITH 
VARIABLE  ONE  AND  THE  ROW  6,  COLUMN  3  ELEMENT  OF  Q 
IS  THE  COEFFICIENT  OF  THE  PRODUCT  OF  VARIABLE  3 
AND  VARIABLE  6.  SINCE  Q  IS  LOWER  TRIANGULAR, 

THERE  IS  NO  DUPLICATION  OF  TERMS.  IN  THE  INPUT 
DATA  SET,  ENTER  A  1,  2,  OR  3  WHERE  THE  NUMBERS 
HAVE  THE  FOLLOWING  MEANING: 

1 —  NO  NONLINEAR  TERMS  IN  THE  FOLLOWER'S 
OBJECTIVE  FUNCTION; 

2 —  THE  Q  MATRIX  WILL  BE  ENTERED  BY  ROW, 
COLUMN,  VALUE; 

3 —  THE  Q  MATRIX  WILL  BE  ENTERED  A  ROW  AT 
A  TIME. 

FURTHER  EXPLANATION  OF  CHOICE  2— THREE  ENTRIES  ARE 
MADE.  THE  FIRST  TWO  ENTRIES  ARE  INTEGER  AND  THE 
THIRD  IS  REAL. 

ENTRY  1 :  THE  ROW  NUMBER ; 

ENTRY  2:  THE  COLUMN  NUMBER; 

ENTRY  3:  THE  COEFFICIENT  OF  THE  NONLINEAR  TERM. 

WHEN  DATA  ENTRY  IS  COMPLETE,  ENTER  999,0,0  ON  THE 
LAST  LINE  OF  THE  INPUT  FILE. 

FURTHER  EXPLANATION  OF  CHOICE  3 — ENTER  ONE  REAL 
NUMBER  PER  LINE.  ALL  ELEMENTS  OF  Q  ON  OR  BELOW 
THE  DIAGONAL  MUST  BE  ENTERED  WITH  ONE  ELEMENT  PER 
LINE.  ENTER  DATA  BY  ROWS  AND  INCLUDE  ZEROS. 
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*  *  *  *  *END  OF  DIRECTIONS***** 


*****VARIABLE  DEFINITIONS***** 


B 

BNDTYP 


BNONL 


COLA 


COLI 


COLLEN 


CONX 


CONY 


CRITV 


ARRAY  WHICH  CONTAINS  THE  COEFFICIENTS  OF 
EACH  VARIABLE  IN  THE  A-  OR  B-MATRIX  OF  THE 
BLPP  OR  MIXED  INTEGER  BLPP . 

IS  THE  RIGHT  HAND  SIDE  ARRAY. 

1  MEANS  LOWER  B0UND=0,  UPPER 
BOUND=+ INFINITY  FOR  EVERY  NON-FREE 
VARIABLE ; 

2  MEANS  LOWER  B0UND=0 ,  UPPER  BOUND=BOUND 
FOR  EVERY  NON-FREE  STRUCTURAL  VARIABLE 

3  MEANS  LOWER  B0UND=0  FOR  EVERY  NON-FREE 
VARIABLE ; 

4  MEANS  BOTH  BOUNDS  ARE  GENERAL. 
COEFFICIENT. 

ARRAY  CONTAINING  THE  COEFFICIENTS  OF  THE 
NONLINEAR  TERMS  IN  THE  FOLLOWER'S 
OBJECTIVE  FUNCTION. 

ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

IS  USED  TO  HOLD  THE  NON-ZERO  COEFFICIENTS 
OF  A  MATRIX  COLUMN  OF  THE  BLPP  OR  MIXED 
INTEGER  BLPP. 

IS  USED  TO  HOLD  THE  ROW  NUMBERS 
CORRESPONDING  TO  THE  NON-ZEROS  OF  A 
MATRIX  COLUMN  OF  THE  BLPP  OR  MIXED 
INTEGER  BLPP. 

IS  AN  ARRAY  USED  TO  HOLD  THE  NUMBER  OF 
NON-ZEROS  IN  A  MATRIX  COLUMN  OF  THE  BLPP 
OR  MIXED  INTEGER  BLPP. 

NUMBER  OF  CONSTRAINTS  CONTAINING  NO 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER. 

NUMBER  OF  COMPLEMENTARY  SLACKNESS 
CONDITIONS  WHICH  MUST  BE  SATISFIED  IN 
SOLVING  THE  BLPP  IN  ITS  EQUIVALENT  KUHN- 
TUCKER  REPRESENTATION.  IN  THE  MIXED 
INTEGER  BLPP,  CRITV  IS  USED  IN  SOLVING 
THE  RELAXED  BLPP. 
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MAXNDS 


NPTYPE 


NSTRUC 


NTERM 


ECHO  FLAG  USED  BY  SOLUTION  ALGORITHMS. 

0  MEANS  DO  NOT  ECHO  INPUT  DATA; 

1  MEANS  ECHO  INPUT  DATA. 

LJ  IS  USED  TO  HOLD  THE  LOWER  BOUND  ON 

A  SINGLE  VARIABLE. 

M  IS  THE  NUMBER  OF  CONSTRAINTS. 

MINMAX  FLAG  INDICATING  NATURE  OF  THE  PROBLEM. 

1  MEANS  MAXIMIZATION  AND  -1  MEANS 
MINIMIZATION. 

MAXNDS  THE  MAXIMUM  NUMBER  OF  VERTICES  IN  THE 

BRANCH  AND  BOUND  TREE  CREATED  WHEN  SOLVING 
THE  BLPP  OR  MIXED  INTEGER  BLPP . 

NPTYPE  INDICATES  THE  TYPE  OF  PROBLEM.  1  MEANS 
THE  PROBLEM  IS  A  BLPP.  2  MEANS  THE 
PROBLEM  IS  A  MIXED  INTEGER  BLPP. 

NSTRUC  THE  TOTAL  NUMBER  OF  VARIABLES  IN  THE 

KUHN-TUCKER  REPRESENTATION  OF  THE  BLPP  OR 
MIXED  INTEGER  BLPP. 

NTERM  INDICATES  IF  THE  PROBLEM  HAS  NONLINEAR 
TERMS  IN  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION. 

1  MEANS  NO  NONLINEAR  TERMS  IN  THE 
FOLLOWER'S  OBJECTIVE  FUNCTION; 

2  MEANS  THE  Q  MATRIX  WILL  BE  ENTERED  BY 
ROW,  COLUMN,  VALUE; 

3  MEANS  THE  Q  MATRIX  WILL  BE  ENTERED  ONE 
ROW  AT  A  TIME. 

NUMX  THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER . 

NUMXY  THE  NUMBER  OF  VARIABLES  IN  THE  BLPP  OR 
MIXED  INTEGER  BLPP. 

NUMY  THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER. 

PRINT  SPECIFIES  THE  LEVEL  OF  PRINTING  DESIRED: 

0  MEANS  ERROR  MESSAGES  ONLY; 

1  MEANS  TERMINATION  CONDITION  MESSAGES; 

2  MEANS  PRINT  OBJECTIVE  FUNCTION  VALUE 
AFTER  EACH  BASIS  RE-FACTORIZATION; 

3  MEANS  LOG  INFORMATION  AT  EVERY 
ITERATION. 

ROWTYP  ARRAY  WHICH  INDICATES  THE  TYPE  OF 
CONSTRAINT: 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 


NUMX 


NUMXY 


NUMY 


PRINT 
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UCOLA  IS  USED  TO  HOLD  THE  NON-ZERO  COEFFICIENTS 
OF  A  MATRIX  COLUMN  OF  ASSOCIATED  WITH  THE 
KUHN-TUCKER  MULTIPLIERS  OF  THE 
STATIONARITY  CONDITIONS. 

UCOLI  IS  USED  TO  HOLD  THE  ROW  NUMBERS 

CORRESPONDING  TO  THE  NON-ZEROS  OF  A 
MATRIX  COLUMN  OF  THE  STATIONARITY 
CONDITIONS. 

UCOLEN  IS  AN  ARRAY  USED  TO  HOLD  THE  NUMBER  OF 
NON-ZEROS  IN  A  MATRIX  COLUMN  OF  THE 
STATIONARITY  CONDITIONS. 

UJ  IS  USED  TO  HOLD  THE  GENERAL  UPPER  BOUND 

OF  THE  PROGRAM;  UJ=200,000. 

VARIABLE . 

UJO  AN  ARRAY  WHICH  STORES  THE  UPPER  BOUND  ON 

THE  VARIABLES  CONTROLLED  BY  THE  LEADER  OR 
THE  FOLLOWER. 

UROW  ARRAY  CONTAINS  VALUES  USED  TO  CREATE  THE 

KUHN-TUCKER  STATIONARITY  CONDITIONS  OF  THE 
FOLLOWER'S  PROBLEM. 

VARTYP  AN  ARRAY  CONTAINING  THE  VARIABLE  TYPE 
WHERE  THE  TYPES  ARE  AS  FOLLOWS: 

0— A  REAL  VALUED,  UNBOUNDED  VARIABLE; 

1 —  AN  INTEGER,  UNBOUNDED  VARIABLE; 

2 —  AN  UPPER  BOUNDED,  INTEGER  VARIABLE; 

3 —  AN  UPPER  BOUNDED,  REAL  VALUED 
VARIABLE . 

XINT  NUMBER  OF  INTEGER  VARIABLES  CONTROLLED  BY 
THE  LEADER. 

YINT  NUMBER  OF  INTEGER  VARIABLES  CONTROLLED  BY 
THE  FOLLOWER. 

*****  END  VARIABLE  DEFINITIONS 

*****NOTE***** 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 

Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 

U  REFERS  TO  KUHN-TUCKER  MULTIPLIERS  ASSOCIATED 
WITH  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  WITH  THE 
NONNEGATIVE  RESTRICTIONS  ON  THE  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER; 

G  REFERS  TO  THE  SLACK  OR  SURPLUS  VARIABLE 
ASSOCIATED  WITH  EACH  CONSTRAINT  CONTAINING 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

*****  END  OF  NOTE*  *  *  *  * 
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REAL  UR0W( 200 , 200 ) , COLA (200) ,B(200) , ACC ( 200 , 200 ) , 

1  CJ1 ( 200 ) , C J2 ( 200 ) , UJ , LJ , UJO ( 200 ) , 

2  BNONL { 200 ,200) , UCOLA ( 400 ) 

INTEGER  CNT,C0LI( 200) ,C0LLEN(200) , CONY , CONX , CONXY , 

1  CRITV , PRINT , ECHO , BNDTYP , ROWTYP ( 200 ) , 

2  VARTYP ( 200 ) , UCOLI ( 400 ) , UC0LEN( 200 ) , 

3  XINT , YINT 
CHARACTER* 4  DUMY 
AONE=l .0 

I0NE=1 
ZER0=0 . 0 
IZERO=0 
DUMY= ' XSUB ' 

NSTRUC=0 

C  ***READ  PROBLEM  INFORMATION*** 

READ  (5,*)  MINMAX, ECHO, PRINT, NPTYPE 
C 

READ  (5,*)  CONX, CONY, NUMX , NUMY , MAXNDS 
C 

NUMXY=NUMX+NUMY 

*  **READ  IN  THE  COEFFICIENTS  OF  THE  VARIABLES  IN 
THE  LEADER'S  OBJECTIVE  FUNCTION*** 

DO  100  1=1 , NUMXY 

READ  (5,*)  CJ1(I) 

100  CONTINUE 

***READ  IN  THE  COEFFICIENTS  OF  THE  VARIABLES  IN 
THE  FOLLOWER'S  OBJECTIVE  FUNCTION*** 

DO  110  1=1, NUMY 

READ  (5,*)  CJ2 { I+NUMX) 

110  CONTINUE 

***READ  IN  CONSTRAINT  TYPE  AND  RIGHT-HAND-SIDE  FOR 
EACH  CONSTRAINT*** 

CONXY=CONX+CONY 
DO  120  1=1, CONXY 

READ  ( 5 , * )  J , ROWTYP ( I ) , B ( I ) 

IF  ( ROWTYP ( I) .EQ.O)  NSTRUC=NSTRUC+1 
120  CONTINUE 

***SET  UPPER  BOUND  FOR  BLPP  VARIABLES 
AT  200,000*** 

DO  125  1=1, NUMXY 
UJO( I) =200000.0 
125  CONTINUE 

***READ  IN  VARIABLE  INFORMATION  AND  NONZERO 
COEFFICIENTS  OF  A-  OR  B-MATRIX*** 
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XINT=0 
YINT=0 

DO  130  1=1, NUMXY 

READ  (5,*)  J , COLLEN ( I ) , VARTYP ( I ) 

IF  ( VARTYP ( I ) . EQ . 0  . OR .  VARTYP ( I ) . EQ . 3 ) 

1  GO  TO  126 

IF  (I.LE.NUMX)  XINT=XINT+1 

IF  (I.GT.NUMX)  YINT=YINT+1 

126  IF  ( VARTYP ( I ) . GE . 2 )  READ  (5,*)  UJO(I) 

IF  ( VARTYP ( I ) . GE . 1  .AND.  I.GT.NUMX) 

1  NSTRUC=NSTRUC+1 

DO  140  K=1 , COLLEN ( I ) 

KBY2=2  *K 

READ  (5,*)  NUMROW , COEFF 
ACC ( I , KBY2- 1 ) = NUMROW 
ACC ( I , KBY2 ) =COEFF 
UROW( I , NUMROW) =COEFF 
140  CONTINUE 
130  CONTINUE 

***READ  IN  COEFFICIENTS  OF  NONLINEAR  TERMS  IN  THE 
FOLLOWER'S  OBJECTIVE  FUNCTION*** 

READ  (5,*)  NTERM 
GO  TO (310,320,330)  NTERM 
320  READ  (5,*)  NROW , NCOL , VALUE 
IF  ( NROW. EQ. 999)  GO  TO  310 
BNONL ( NROW , NCOL ) =VALUE - 
GO  TO  320 

330  DO  50  1=1, NUMXY 
DO  60  J=1 , I 

READ  (5,*)  BNONL ( I, J) 

60  CONTINUE 
50  CONTINUE 
310  BNDTYP=4 

UJ=200000 . 0 
LJ=0 .0 

CRI T V=NUMY+C  ONY 
M=NUMY+CONY+CONX 

NSTRUC=NUMY+NUMY+CONY+CONY+NUMX+NSTRUC 
C0NX1=C0NX+1 
NUMX 1 =NUMX+ 1 
C  *  *  *WRITE  PROBLEM  INFORMATION*** 

IF  ( NPTYPE . EQ . 1 ) 

1  WRITE  (6,905)  CRITV , NUMX , NUMY , CONX , CONY , MAXNDS 
905  FORMAT  (615) 
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IF  ( NPTYPE . EQ . 2 ) 

1  WRITE  (6,906)  CRITV , NUMX , NUMY , CONX , CONY , XINT , 

2  YINT , MAXNDS 
906  FORMAT (815) 

WRITE  (6,908)  M , NSTRUC , MINMAX, ECHO , PRINT , BNDTYP 
908  FORMAT (615) 

***WRITE  INFORMATION  ON  CONSTRAINTS  WITH  NO 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER*** 

DO  150  1=1, CONX 

WRITE  (6,910)  I , ROWTYP ( I ) , B ( I ) 

150  CONTINUE 

910  FORMAT ( 215, F13. 3) 

***WRITE  INFORMATION  ON  CONSTRAINTS  WITH  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER*** 

DO  155  I=C0NX1 , CONXY 

WRITE  (6,910)  I , IZERO , B ( I ) 

155  CONTINUE 

***WRITE  RHS  OF  U-ROWS  TO  DATA  SET  (ISEQ,  ROWTYP, 
GRADIENT  WITH  RESPECT  TO  Y — LINEAR  TERMS)*** 

DO  160  1=1, NUMY 
K=I+CONXY 
J=I+NUMX 

WRITE  (6,910)  K, IZERO, -CJ2(J) 

160  CONTINUE 

***WRITE  THE  TERMS  TO  THE  GRADIENT  ROWS  WHICH 
ARE  DERIVED  FROM  THE  NONLINEAR  TERMS  IN  THE 
FOLLOWER'S  OBJECTIVE  FUNCTION*** 

IF  (NTERM.EQ.l)  GO  TO  225 
DO  350  I=NUMX1 , NUMXY 
I  ROW=C  ONXY  + 1  -  NUMX 
DO  360  J=1,I 

IF  ( BNONL ( I , J ) . EQ . 0 . 0 )  GO  TO  360 
COLLEN ( J ) =COLLEN ( J ) +1 
K=COLLEN( J) *2 
ACC ( J , K-l ) =IROW 
ACC ( J , K ) =BNONL ( I , J ) 

IF  (J.EQ.I)  ACC ( J , K) =2 . 0*BN0NL( I , J ) 

IF  (J.LE.NUMX  .OR.  J.EQ.I)  GO  TO  360 

IR0W1=C0NXY+J-NUMX 

COLLEN ( I ) =C0LLEN ( I ) +1 

K=2  *COLLEN ( I ) 

ACC ( I , K- 1 ) =IR0W1 
ACC ( I , K ) =BNONL ( I , J ) 

360  CONTINUE 
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350  CONTINUE 

C  ***WRITE  X  VARIABLE  INFO  AND  COLUMNS*** 

225  DO  230  I=1,NUMX 

ICOLL=COLLEN ( I ) 

WRITE  (6,915)  DUMY , I , ICOLL , CJ1 ( I ) , 

1  U JO ( I ) , LJ , VARTYP ( I ) 

ICOLL2=2* ICOLL 
DO  235  J=1 , IC0LL2 , 2 
IB=ACC ( I , J ) 

234  WRITE  (6,920)  IB , ACC ( I , J+l ) 

235  CONTINUE 
230  CONTINUE 

* **WRITE  Y  VARIABLE  INFO  AND  COLUMNS  TO  DATA 
SET*** 

DO  170  I=NUMX1 ,NUMXY 
ICOLL=COLLEN ( I ) 

ICOLL2=2* ICOLL 
ISEQ=I 

WRITE  (6,915)  DUMY , ISEQ , ICOLL , CJ1 ( I ) , 

1  UJO(I) ,LJ,VARTYP(I) 

DO  180  J=1 , IC0LL2 , 2 
IB=ACC ( I , J ) 

WRITE  (6,920)  IB , ACC ( I , J+l ) 

180  CONTINUE 
170  CONTINUE 

•••WRITE  G'S  OF  CONSTRAINTS  WITH  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER*** 

DO  190  1=1, CONY 
IDUM=I+CONX 
ISEQ=NUMXY+I 

IF  ( ROWTYP ( IDUM ) . EQ . 0 )  U J=0 . 0 

WRITE  (6,915)  DUMY, ISEQ, IONE, ZERO, UJ,LJ,IZER0 
UJ=200000 . 0 

IF  (ROWTYP ( IDUM ) .EQ.-l)  A0NE=-1.0 
WRITE  (6,920)  IDUM , AONE 
A0NE=1 .0 
190  CONTINUE 

C  ***WRITE  THE  U'S  OF  THE  Y  .GE.  0  CONSTRAINTS*** 

DO  200  1=1, NUMY 

I S  EQ=NUMXY+CONY + 1 
IROW=I+CONXY 

WRITE  (6,915)  DUMY, ISEQ, IONE, ZERO, UJ,LJ,IZERO 
WRITE  (6,920)  IROW,AONE 
200  CONTINUE 

C  * **WRITE  THE  U'S  WHICH  ARE  THE  KUHN-TUCKER 
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MULTIPLIERS  OP  CONSTRAINTS  WITH  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  ARE  DERIVED 
FROM  THE  EQUATION: 

GRAD(F{ Y) ) -U*GRAD(G(Y) )=0*** 

LENCNT=0 

DO  210  I=C0NX1 , CONXY 
CNT=0 

DO  215  J=NUMX1 , NUMXY 

IF ( UROW ( J  ,  I ) . EQ .0.0)  GO  TO  215 
CNT=CNT+1 

COLA { CNT) =-UR0W( J , I ) 

IF  (ROWTYP(I) .EQ.-l)  COLA( CNT) =UROW( J , I ) 

COLI ( CNT ) = J+CONXY-NUMX 
215  CONTINUE 

ISEQ=I+CONY+NUMY+NUMY+NUMX-CONX 
WRITE  (6,915)  DUMY, ISEQ , CNT , ZERO , UJ , LJ , I ZERO 
IF  ( ROWTYP ( I ) . NE . 0 )  GO  TO  650 
UCOLEN(I)=CNT 
LENCNT=LENCNT+CNT 
KSTART=LENCNT-CNT+ 1 
KPNT=1 

DO  610  K=KSTART , L5NCNT 
UCOLI ( K ) =COLI ( KPNT ) 

UCOLA ( K ) =-COLA ( KPNT ) 

WRITE  (6,920)  COLI (KPNT) , COLA (KPNT) 
KPNT=KPNT+ 1 
610  CONTINUE 

GO  TO  210 

650  DO  220  K=1 , CNT 

WRITE  (6,920)  COLI ( K) , COLA( K) 

220  CONTINUE 

210  CONTINUE 

***WRITE  U'S  WHICH  ARE  THE  KUHN-TUCKER  MULTIPLIERS 
ASSOCIATED  WITH  UPPER  BOUND  CONSTRAINTS  ON  Y*** 
I SEQ=CONY+CONY+NUMY+NUMY+NUMX 
CNT=0 

DO  400  I=NUMX1 , NUMXY 
CNT=CNT+1 

IF  ( VARTYP ( I ) . EQ . 0 )  GO  TO  400 
ISEQ=ISEQ+1 

WRITE  (6,915)  DUMY , ISEQ , I ONE , ZERO , UJ , LJ , I ZERO 
IROW=CONXY+CNT 
WRITE  (6,920)  IROW,-AONE 
400  CONTINUE 

C  ***WRITE  U'S  WHICH  ARE  THE  KUHN-TUCKER  MULTIPLIERS 
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FOR  THE  EQUALITY  CONSTRAINTS  WITH  VARIABLES  i 

CONTROLLED  BY  THE  FOLLOWER***  \ 

CNT=0 

DO  500  I=C0NX1 , CONXY  ! 

IF  ( ROWTYP { I )  . NE . 0 )  GO  TO  500  t 

CNT=CNT+UCOLEN ( I )  ! 

ISEQ=ISEQ+1  ] 

WRITE  (6,915)  DUMY , ISEQ , UCOLEN ( I ) ,  ) 

1  ZERO , UJ , LJ , IZERO 

KSTART=CNT-UCOLEN ( I ) +1  J 

DO  510  K=KSTART , CNT  * 

WRITE  (6,920)  UCOLI ( K) , UCOLA ( K )  I 

510  CONTINUE 

500  CONTINUE  ( 

915  FORMAT (A4, 215, F15. 5, 2F10. 0,12) 

920  FORMAT ( I 5 , F 1 5 . 5 )  ! 

STOP  \ 
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A. 5. 3.  The  BLPP  Algorithm 

The  algorithm  for  the  BLPP  is  computerized  by  the 
following  program.  The  program  solves  problems  created 
using  the  random  problem  generator  of  section  A. 5.1  or 
problems  which  were  input  using  the  code  of  section 
A. 5. 2.  For  definitions  of  the  XMP  variables,  refer  to 
section  A. 4. 
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PROGRAM  BLPP 


C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 
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c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 
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** ♦PURPOSE*** 


THIS  PROGRAM  SOLVES  THE  LINEAR  BLPP  WHERE  ALL 
VARIABLES  HAVE  POSITIVE  REAL  VALUES. 


THE  PROGRAM  READS  IN  THE  LINEAR  PROBLEM  WHICH 
RESULTS  WHEN  THE  KUHN-TUCKER  APPROACH  IS  USED  TO 
REWRITE  THE  BLPP  AS  A  STANDARD  LINEAR  PROGRAMMING 
PROBLEM.  A  BRANCH  AND  BOUND  SCHEME  WHICH  FORCES 
SATISFACTION  OF  THE  COMPLIMENTARY  SLACKNESS 
CONDITIONS  THROUGH  MANIPULATION  OF  THE  KUHN- 
TUCKER  MULTIPLIERS  AND  THEIR  ASSOCIATED  EQUATIONS 
IS  USED  TO  FIND  THE  OPTIMAL  SOLUTION  OF  THE  BLPP. 
THE  XMP  LIBRARY  OF  LINEAR  PROGRAMMING  SUBROUTINES 
IS  USED  TO  SOLVE  THE  LINEAR  PROGRAMMING  SUBPROBLEM 
AT  EACH  VERTEX  OF  THE  BRANCH  AND  BOUND  TREE. 


THIS  PROGRAM  READS  IN  THE  PROBLEM  DATA  AND  PASSES 
IT  TO  XMP  WHICH  SOLVES  THE  LINEAR  PROGRAM  BY  THE 
PRIMAL  SIMPLEX  METHOD.  THE  SOLUTION  IS  USED  TO 
SELECT  A  VARIABLE  ON  WHICH  TO  BRANCH.  WHEN  ALL 
LIVE  VERTICES  IN  THE  BRANCH  AND  TREE  HAVE  BEEN 
FATHOMED,  THE  INCUMBENT  SOLUTION  IS  DECLARED 
OPTIMAL . 


THE  PROGRAM  DOES  NOT  TAKE  ANY  ADVANTAGE  OF  SPECIAL 
PROBLEM  TYPE  OR  STRUCTURE.  FOR  MOST  SERIOUS 
APPLICATIONS  YOU  WILL  WANT  TO  WRITE  A  MATRIX 
GENERATOR  THAT  READS  IN  DATA  TABLES  AND  GENERATES 
THE  LP  COEFFICIENT  MATRIX  OF  THE  EQUIVALENT  KUHN- 
TUCKER  FORMULATION  OF  THE  BLPP  PROBLEM.  THE 
PROGRAM  BLPPRD  CAN  BE  USED  TO  DO  THIS. 


** ‘DICTIONARY  OF  VARIABLES*** 


XMP  VARIABLES — FOR  DEFINITIONS  SEE  THE 
XMP  DICTIONARY 


VARIABLES  USED  IN  BLPP  BRANCH  AND  BOUND 


BBTBIG  CONTAINS  VALUE  OF  BIGGEST  PRODUCT  IN  TEST 
FOR  SELECTION  OF  THE  BRANCHING  VARIABLE. 
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c 

BBTEMP 

CONTAINS  VALUE  OF  PRODUCT  IN  TEST 

c 

c 

BBVAR 

FOR  SELECTION  OF  THE  BRANCHING  VARIABLE. 

AN  ARRAY  WHICH  CONTAINS  THE  VALUES  OF 

c 

c 

c 

BESTAT 

THE  VARIABLES  AT  THE  CURRENT  VERTEX  OF 

THE  BRANCH  AND  BOUND  TREE. 

IS  THE  STATUS  OF  EACH  VARIABLE  IN  THE 

c 

c 

c 

BESTB 

INCUMBENT  SOLUTION.  REFER  TO  THE  XMP 
DICTIONARY  FOR  A  DEFINITION  OF  STATUS. 

IS  THE  LIST  OF  BASIC  VARIABLES  IN  THE 

c 

c 

BESTLB 

INCUMBENT  SOLUTION. 

ARRAY  WHICH  CONTAINS  THE  LOWER  BOUNDS  ON 

c 

c 

BESTUB 

THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION. 
ARRAY  WHICH  CONTAINS  THE  UPPER  BOUNDS  ON 

c 

c 

BLVAR 

THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION. 
POINTS  TO  POSITION  WHERE  KUHN-TUCKER 

c 

c 

c 

CJ1 

MULTIPLIERS  OF  UPPER  BOUND  ON  VARTYP  =  3 
VARIABLES  IS  FOUND  IN  BBVAR. 

ARRAY  WHICH  STORES  THE  COEFFICIENTS  OF  THE 

c 

c 

CONX 

LEADER'S  OBJECTIVE  FUNCTION. 

NUMBER  OF  CONSTRAINTS  WHICH  DO  NOT  CONTAIN 

c 

c 

CONY 

ANY  VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  WHICH  CONTAIN 

c 

c 

CRITV 

VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

IS  THE  NUMBER  OF  COMPLEMENTARY  SLACKNESS 

c 

c 

c 

DUMCNT 

CONDITIONS  WHICH  MUST  BE  SATISFIED  BY 

BY  THE  SOLUTION  OF  THE  BLPP . 

USED  TO  KEEP  TRACK  OF  WHICH  UPPER  BOUNDED 

c 

c 

IVARU 

VARIABLE  IS  BRANCHED  ON  AT  CURRENT  VERTEX. 
USED  TO  KEEP  TRACK  OF  WHICH  UPPER  BOUNDED 

c 

c 

LEVEL 

VARIABLE  IS  BRANCHED  ON  AT  EACH  VERTEX. 
CONTAINS  THE  LEVEL  OF  THE  CURRENT  VERTEX 

c 

c 

NODE 

OF  THE  BLPP  BRANCH  AND  BOUND  TREE. 

COUNTS  NUMBER  OF  VERTICES  IN  THE  BRANCH 

c 

c 

NODBST 

AND  BOUND  TREE 

STORE  VERTEX  AT  WHICH  INCUMBENT  SOLUTION 

c 

c 

NSTOPV 

FOUND . 

COUNTER  USED  IN  LOOP  USED  TO  SELECT  THE 

c 

c 

NSTRUC 

VARIABLE  ON  WHICH  TO  BRANCH. 

NUMBER  OF  VARIABLES  IN  THE  KUHN-TUCKER 

c 

c 

NUMITR 

REPRESENTATION  OF  THE  BLPP. 

MAXIMUM  NUMBER  OF  S  IN  THE  BRANCH  AND 

c 

c 

NUMX 

BOUND  TREE. 

NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 

c 

c 

NUMY 

LEADER. 

NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
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C 

C 

C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


FOLLOWER. 

OKBAS  ARRAY  WHICH  STORES  THE  MOST  CURRENT 
FEASIBLE  BASIS. 

OKSTAT  ARRAY  WHICH  STORES  STATUS  OF  EACH  VARIABLE 
IN  THE  MOST  CURRENT  FEASIBLE  BASIS. 

UJO  ARRAY  WHICH  STORES  THE  UPPER  BOUNDS  OF 

VARIABLES  WHICH  HAVE  UPPER  BOUNDS. 

VARTYP  INDICATES  THE  VARIABLE  TYPE. 

0  MEANS  A  VARIABLE  IS  REAL  VALUED; 

1  MEANS  A  VARIABLE  IS  INTEGER  VALUED; 

2  MEANS  A  VARIABLE  HAS  AN  UPPER  BOUND  AND 
IS  INTEGER  VALUED; 

3  MEANS  A  VARIABLE  HAS  AN  UPPER  BOUND  AND 
AND  IS  REAL  VALUED. 

NOTE:  ONLY  VARTYPS  OF  0  OR  3  ARE  ALLOWED 

THIS  ALGORITHM. 

VCNT  A  COUNT  ON  NUMBER  OF  UPPER  BOUNDED 
VARIABLES  ( VARTYP  -  3)  . 

W  IS  AN  ARRAY  WHICH  INDICATES  WHICH 

COMPLEMENTARY  SLACKNESS  CONDITIONS  HAVE 
BEEN  FORCED  TO  BE  SATISFIED  IN  THE  BRANCH 
AND  BOUND  TREE.  A  NEGATIVE  VALUE  MEANS 
THE  KUHN-TUCKER  MULTIPLIER  IS  SET  TO 
ZERO,  AND  A  POSITIVE  VALUE  MEANS  A 
CONSTRAINT  IS  FORCED  TO  BE  TIGHT. 

XBEST  THE  ARRAY  CONTAINING  THE  VALUES  OF  THOSE 

VARIABLES  WHICH  ARE  BASIC  IN  THE  INCUMBENT 
SOLUTION. 

YCJ  THE  ARRAY  CONTAINING  THE  COEFFICIENTS  OF 

THE  VARIABLES  IN  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION. 

ZBEST  VALUE  OF  THE  INCUMBENT  SOLUTION  OF  THE 
BLPP  . 

*****END  DEFINITIONS*  *  *  *  * 


*»***NOTE***** 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 

Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 
U  REFERS  TO  KUHN-TUCKER  MULTIPLIERS  ASSOCIATED 
WITH  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  WITH  THE 
NONNEGATIVE  RESTRICTIONS  ON  THE  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER; 

G  REFERS  TO  THE  SLACK  OR  SURPLUS  VARIABLE 
ASSOCIATED  WITH  EACH  CONSTRAINT  CONTAINING 


CO  to  H  ^  CO  [O  H 


VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

*****END  OF  NOTE***** 

*  *  *  SUMMARY  OF  INPUT  FORMATS:*** 

CRITV , NUMX , NUMY , CONX . CONY , NUMITR  615 

M , NSTRUC , MINMAX , ECHO , PRINT , BNDTYP  615 

(I,  ROWTYP { I )  ,  B ( I ) )  1=1, M  2I5.F10.0 

XSUB , J , COLLEN , C J , UJ , LJ  A4 , 215 , 3F10 . 0 

(I,  A( I , J ) )  FOR  I  WITH  A( I , J )  NONZERO  I5,F10.0 

INTEGER  TOTCP1 , VIRCP1 , TOTCP2 , VIRCP2 , TOTCP , VIRCPC 

***DOUBLE  PRECISION  ARRAYS  AND  VARIABLES*** 

DOUBLE  PRECISION  B ( 100 ) , BASCB ( 100 ) , BASLB ( 100 ) , 

BASUB(IOO) , BOUND , CANDA ( 100,6) , 
CANDC J ( 6 ) , CJ , COLA( 100 ) , 

LJ,MEMR( 11000) ,UJ,UZERO( 100) , 
XBZERO ( 100) ,YQ( 100) ,Z 

IF  YOU  HAVE  ANY  TWO-SIDED  CONSTRAINTS  (ROWTYP=2), 
THEN  DIMENSION  BLOW(MAXM) ,  THE  SAME  AS  B(MAXM). 
OTHERWISE,  JUST  DIMENSION  BLOW(l). 

NOTE:  THIS  VERSION  OF  XDEMO  DOES  NOT  ALLOW 

TWO-SIDED  CONSTRAINTS. 

DOUBLE  PRECISION  BLOW(l) 

INTEGER  ARRAYS  AND  VARIABLES. 

INTEGER  BNDTYP , COLLEN , COLMAX , DFEASQ , DTERM , DUNBR , 
ERROR , FACTOR , IOERR , IOLOG , ITER , 

ITER1 , ITER2 , LOOK , M , MAPI ( 9 ) ,MAPR(8) , 

MAXA , MAXM , MAXN , N , NTYPE2 , PICK , PRINT , 

TERMIN , UNBDDQ 
INTEGER  MEMI( 11000) 

INTEGER  BASIS ( 100) ,CAND( 6) ,CANDI ( 100 ,6) , CANDL ( 6 ) , 
1  COLI ( 100 ) , ROWTYP ( 100 ) , STATUS ( 600 ) 

DOUBLE  PRECISION  C JTEMP , ZTEMP , UTEMP 
INTEGER  ECHO , IOIN , ISEQ , JSEQ , JSEQ2 , NSTRUC , MINMAX 
CHARACTER* 4  DUMY 
CHARACTER* 4  XSUB 


ooo  ooooo  oo  ooo 
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C  VARIABLES  NEEDED  FOR  BLPP  BRANCH  AND  BOUND 

DOUBLE  PRECISION  BBVAR ( 600 ) , XBEST ( 100 ) , ZBEST , 

1  BBTBIG 

INTEGER  LEVEL, CRITV,W( 600) ,BESTB(100) ,BESTAT(600) , 

1  L,  IX , NUMX , NUMY , C0NX , CONY , NSTOPV , NUMX1 , 

2  NUMXY , FLGUP , BLVAR , C0NXY , 0KBAS (100), 

3  OKSTAT ( 600 ) 

DOUBLE  PRECISION  BBTEMP , BESTLB ( 600 ) , BESTUB ( 600 ) , 

1  CJ1(600) ,UJO(600) ,YCJ(600) 

INTEGER  DUMONT , I VARU ( 600 ) , VARTYP ( 600 ) , 

1  VCNT , FLAGUP ( 600 ) 

*****COMMON  VARIABLES 

THE  COMMON  VARIABLES  ARE  USED  AS  NUMERICAL  CHECKS 
IN  THE  XMP  SUBROUTINES. 

COMMON/XMPCOM/BIG , SMALL , ZL , ZLC , EPS1 , EPS2 , 

1  EPS3 , EPS4 , EPS5 , EPS6 

DOUBLE  PRECISION  BIG , SMALL , ZL , ZLC , EPS1 , EPS2 , 

1  EPS3 , EPS4 , EPS5 , EPS6 

COMMON/XMPLEN/LENI , LENMI , LENMR , LENR 
INTEGER  LENI , LENMI , LENMR , LENR 

XSUB  IS  USED  AS  A  CHECK  IN  READING  IN  DATA. 

DATA  XSUB /'XSUB'/ 


*****BODY  OF  PROGRAM***** 


I0IN=5 
IOERR=6 
I0L0G=6 

*  *  *PRINT  HEADING*** 

WRITE ( IOLOG ,917) 

917  F0RMAT( 1H1///10X, 'BLPP  PROGRAM') 
C  ***INITIALIZE  XMP  VARIABLES*** 

MAXA=4000 
MAXM= 100 
MAXN=600 
C0LMAX=100 
C 

PICK=6 

L00K=200 

FACT0R=50 


tin 


v.Wivm'tW 


oo  an  an  oo  ooo 
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LENI=1 1000 
LENR=1 1000 
LENMI=9 
LENMR=8 

♦♦♦READ  IN  PROBLEM  INFORMATION*** 

READ { I0IN , 900 )  CRITV , NUMX , NUMY , C0NX , CONY , NUMITR 

READ ( IOIN , 900 )  M , NSTRUC , MINMAX , ECHO , PRINT , BNDTYP 
900  FORMAT (615) 

WRITE  (6,898)  NUMX , NUMY , C0NX , CONY 
898  FORMAT ( '  NUMX  ',14,'  NUMY  ',14,'  CONX  ',14, 

1  '  CONY  ' , 14) 

♦♦♦INITIALIZE  BRANCH  AND  BOUND  VARIABLES*** 

NUMXY=NUMX+NUMY 

NUMXY 1 =NUMXY + 1 

NUMX1=NUMX+1 

CONXY=CONX+CONY 

NSTOPV=CRITV+NUMX 

BLVAR=NUMX+NUMY+C  ONY +NUMY+C0NY 

ZBEST=-1 . 0D25 

N0DE=0 

N0DBST=0 

LEVEL=0 

DO  1199  J=l, NSTRUC 
1199  BBVAR( J ) =0 . 0 

DO  1198  J=1 , NSTOPV 
1198  W(J)=0 


IF (MINMAX  .EQ.  1 ) WRITE ( IOLOG , 960 ) 

IF (MINMAX  .EQ.  - 1 ) WRITE ( IOLOG , 96 1 ) 

960  FORMAT ( 1H0 , 10X , 26HTHIS  IS  A  MAXIMIZATION  RUN//) 

961  FORMAT ( 1H0 , 10X , 26HTHIS  IS  A  MINIMIZATION  RUN//) 


WRITE (IOLOG, 918 )M 

918  FORMAT ( 1H0 , 5X, 16 , 2X, 1 1HC0NSTRAINTS ) 

WRITE ( IOLOG ,919) NSTRUC 

919  F0RMAT{ 1H0 , 5X, 16 , 2X, 20HSTRUCTURAL  VARIABLES///) 


o  o  o  o  o  o  o 


CALL  XMAPS ( BNDTYP , IOERR , MAPI , MAPR , MAXA , MAXM 
1  MAXN , MEM I , MEMR ) 

C 

C 

C  READ  IN  THE  ROW  TYPES  AND  THE  RIGHT-HAND-SIDE. 

C  ISEQ  IS  THE  ROW  NUMBER,  FOR  THE  USER'S 

C  CONVENIENCE . 

U 

NOSX=NUMX 
DO  100  1=1, M 

READ ( IOIN , 902 )  ISEQ , ROWTYP ( I ) ,B(I) 

IF  ( I . LE . CONXY ) GO  TO  100 

N0SX=N0SX+1 

YCJ ( NOSX) =-B ( I ) 

100  CONTINUE 

902  FORMAT ( 215, F13. 3) 


IF (ECHO  .LT.  1)G0  TO  110 
WRITE (IOLOG, 913) 

913  FORMAT ( // / 10X , 7HR0W  NO . , 10X , 8HR0W  TYPE,10X, 
X  16H  RIGHT-HAND-SIDE/) 

DO  105  1=1, M 

105  WRITE (IOLOG, 9 14)  I , ROWTYP ( I ) , B ( I ) 

914  FORMAT ( 10X , 17 , 10X , 18 , 10X, D16 . 8 ) 

110  CONTINUE 


N  IS  THE  CURRENT  NUMBER  OF  VARIABLES. 

N  IS  INCREMENTED  BY  XADDAJ  AS  EACH  COLUMN 
IS  ADDED. 

N=0 

jSEQ2=0 
C 

c 

C  ***READ  IN  THE  COLUMNS  ONE  AT  A  TIME*  *  * 

C 

C  JSEQ  IS  A  SEQUENCE  NUMBER  FOR  THE  USER'S 

C  CONVENIENCE 

C  ( XMP  NUMBERS  THE  COLUMNS  SEQUENTIALLY  AS  THEY  ARE 

C  SENT  TO  XADDAJ  AND  RETURNS  THIS  NUMBER  IN  IDNO) 

C 

INTCNT=0 

C 

DO  120  J=1 , NSTRUC 


oo  oo  oo  o  o 


READ ( IOIN , 904 )  DUMY , JSEQ , COLLEN , C J , 

1  U J , L J , VARTYP ( J ) 

904  FORMAT (A4 , 215, F15.5,2F10. 0,12) 

UJO( J)=UJ 

CJ1{ J)=CJ 

IF (DUMY  .EQ.  XSUB ) GO  TO  1105 
WRITE ( IOERR , 901 ) JSEQ2 

901  FORMAT ( 31H  ERROR  IN  INPUT  FILE  AFTER  XSUB, 15) 
STOP 

1105  JSEQ2=JSEQ 

FLIP  THE  SIGN  OF  THE  OBJECTIVE  FUNCTION 
COEFFICIENT  IF  WE  ARE  MINIMIZING. 

CJTEMP=C J 

IF (MINMAX  .EQ.  -1)  CJTEMP=-CJ 
DO  130  K=l, COLLEN 

READ( IOIN, 905)  COLI (K) , COLA(K) 

130  CONTINUE 

905  FORMAT ( I 5 , F 1 5 . 5 ) 

CALL  XADDAJ ( CJTEMP , COLA , COLI , COLLEN , COLMAX , 

1  IOERR , IDNO , MAP I , MAPR , MEMI , MEMR , N ) 

IF ( BNDTYP  .GT.  l)GO  TO  112 
LJ=0 . 0 
UJ=BIG 
GO  TO  115 

112  IF ( BNDTYP  .GT.  2)GO  TO  113 

ERROR=3 

CALL  XSTOP ( ERROR , I OERR ) 

113  IF (BNDTYP  . EQ .  3)  LJ=0.0 

CALL  XADDUB ( BNDTYP , IOERR , IDNO , LJ , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

115  IF ( ECHO  .LT.  1)G0  TO  120 

WRITE ( IOLOG ,915) IDNO , C J , U J , L J 

915  FORMAT { / IX , 2HJ= , 15 , 5X , 3HC J= , D16 . 8 , 5X , 

1  3HUJ= , D16 . 8 , 5X , 3HLJ= , D16 . 8 ) 

DO  118  K=l, COLLEN 

WRITE( IOLOG, 916)  COLI ( K ), COLA ( K ) 

118  CONTINUE 

916  FORMAT (13X,I6,5X,D16.8) 

120  CONTINUE 

*  *  * START  ALL  OF  THE  STRUCTURAL  VARIABLES  AT  THEIR 


oo  oooooo  o  oo 


LOWER  BOUNDS*** 

DO  170  J=1 ,  N 
STATUS { J ) =0 
170  CONTINUE 

CALL  XSLACK { B , BASCB , BASIS , BASLB , BASUB , 

1  BLOW , BNDTYP , BOUND , 

2  COLA , COLI , COLMAX , IOERR , 

3  M , MAP I , MAPR , MAXM , MAXN , MEMI , 

4  MEMR , N , ROWTYP , STATUS , 

5  UZERO , XBZERO , Z ) 

CPTIME  IS  A  UTILITY  USED  ON  THE  UNIVERSITY 
OF  TEXAS  IBM  COMPUTER  TO  FIND  CPU  TIME 
CALL  CPTIME ( T0TCP1 ,VIRCP1 ) 

GO  TO  4500 

***BEGIN  BLPP  BRANCH  AND  BOUND*** 

1999  CONTINUE 

IF  ( NODE . LT . NUMI TR )  GO  TO  4005 
FLG0UT=1 .0 
GO  TO  6000 

4005  IF  (TERMIN.NE.l)  GO  TO  2500 
DO  4010  K=1,M 

OKB AS ( K ) =BAS I S ( K ) 

4010  CONTINUE 

DO  4020  K=1 , N 

OKSTAT ( K ) =STATUS ( K ) 

4020  CONTINUE 

IF  ( ZTEMP . LE . ZBEST )  GO  TO  3100 

*  * ‘DETERMINE  VALUE  OF  VARIABLES  IN  SOLUTION  AT 
CURRENT  NODE*** 

DO  670  I=NUMX1 , NSTRUC 

IF  ( STATUS ( I ) )  400,500,600 
400  IF  ( STATUS ( I ) . EQ . - 2  .OR.  STATUS ( I ) . EQ . -3 ) 

1  GO  TO  430 

IF  ( STATUS ( I) .EQ.-4)  GO  TO  500 

CALL  XGETUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

BBVAR( I ) =UJ 
GO  TO  670 

430  DO  440  J=1 , M 

IF{BASIS(J) . NE . I )  GO  TO  440 
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1200 


BBVAR { 1 ) =XBZER0 ( J ) 

GO  TO  670 
CONTINUE 

IF  ( BNDTYP . NE . 4 )  GO  TO  555 

CALL  XGETUB ( BNDTYP , IOERR , I , LJ , MAPI , MAPR , 

L  MEMI , MEMR , U J ) 

IF  (LJ.EQ.O.O)  GO  TO  555 

BBVAR ( I ) =L J 

GO  TO  670 

BBVAR ( I ) =0 . 0 

GO  TO  670 

IX=STATUS ( I ) 

BBVAR ( I ) =XBZERO ( IX ) 

CONTINUE 

♦♦♦FEASIBILITY  CHECK/SELECT  BRANCHING  VARIABLE* ♦ * 
THIS  SECTION  CHECKS  TO  SEE  IF  EACH  COMPLEMENTARY 
SLACKNESS  CONDITION  IS  SATISFIED  (IE  IF  U*G=0). 

IF  YES,  THEN  FEASIBLE  SOLUTION  FOUND.  IF  NO, 

THEN  PICK  LARGEST  VALUE  OF  U*G  AND  BRANCH  ON 
U  (IE  MAKE  U  ZERO) 

FLAG= 1  MEANS  WORKING  WITH  A  VARIABLE  AT 
ITS  LOWER  BOUND. 

FLAG=2  MEANS  WORKING  WITH  A  VARIABLE  AT 
ITS  UPPER  BOUND. 

BBTBIG=0 . 0 

VCNT=0 

FLGUP=1 

DO  1200  I=NUMX1 , NSTOPV 

IF  ( VARTYP ( I ) . EQ . 0  .OR.  I.GT.NUMXY)  GO  TO  1210 
VCNT=VCNT+1 

BBTEMP= ( U JO ( I ) -BBVAR ( I ) ) ♦BBVAR ( BLVAR+VCNT ) 

IF  ( BBTEMP . LE . BBTBIG )  GO  TO  1210 

BBTBIG=BBTEMP 

KK=  I 

DUMCNT=VCNT 

FLGUP=2 

BBTEMP =BBVAR( I ) *BBVAR( I+CRITV) 

IF  ( BBTEMP. LE. BBTBIG)  GO  TO  1200 
BBTBIG=BBTEMP 
KK=I 
FLGUP=1 
CONTINUE 

IF  (BBTBIG. LE. 0.000001)  GO  TO  2000 
* ♦♦BRANCH  ON  SELECTED  VARIABLE*** 

BRANCHES  ON  SELECTED  U  VARIABLE (IE  SETS  U  TO  0 ) 


iafil 


o  o  o  o  o  o  o 
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W-ARRAY  USED  TO  TELL  WHICH  VARIABLE  OF  A  U-G  PAIR 
IS  SET.  W( I ) =K  MEANS  VARIABLE  K  SET  AT  LEVEL  I  OF 
TREE.  IF  K<0  THAT  MEANS  ALTERNATIVE  OF  U-G  PAIR 
NOT  YET  CONSIDERED. 

1500  LEVEL=LEVEL+ 1 
N0DE=N0DE+1 
FLAGUP ( LEVEL ) =FLGUP 
GO  TO  (1510,1520)  FLAGUP ( LEVEL ) 

1510  W( LEVEL) =-KK 
L=KK+CRITV 
UJ=0 . 0 
LJ=0 . 0 

CALL  XADDUB ( BNDTYP , 10 ERR , L , L J , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

GO  TO  4000 
1520  W( LEVEL )=-KK 

L=BLVAR+DUMCNT 
UJ=0 . 0 
LJ=0 . 0 

IVARU ( LEVEL ) =DUMCNT 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

GO  TO  4000 

*  *  *A  NEW  INCUMBENT  SOLUTION  FOUND*** 

2000  DO  2100  K=1,M 

XBEST ( K ) =XBZER0 ( K ) 

BESTB ( K ) =BAS I S ( K ) 

2100  CONTINUE 

DO  2200  K=1 , N 

BESTAT ( K ) =STATUS ( K ) 

2200  CONTINUE 

DO  2250  K=1 , NSTRUC 

CALL  XGETUB ( BNDTYP , IOERR , J , L J , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

BESTLB ( K) =LJ 
BESTUB(K) =UJ 
2250  CONTINUE 

NODBST=NODE 

ZBEST=ZTEMP 

IF  ( LEVEL. EQ.O)  GO  TO  6000 
GO  TO  3100 

2500  IF  (TERMIN.EQ. 2)  GO  TO  5000 

IF  (TERMIN.NE.l  .AND.  NODE. EQ.O)  GO  TO  5000 
** ‘BACKTRACK*** 

FINDS  A  LIVE  NODE,  FREES  U  VAR,  AND 


o  ci  a  o  o  o  o 


SETS  G  VAR  TO  0 

ALSO  FREES  VARIABLES  WHICH  HAVE  HAD  BOTH 
ALTERNATIVES  CONSIDERED. 

3100  CONTINUE 

IF  ( LEVEL. EQ.O)  GO  TO  6000 
IF( W( LEVEL ) .LT.O)  GO  TO  3200 
L=W( LEVEL) 

U J=U JO ( L ) 

LJ=0.0 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

W( LEVEL )=0 
LEVEL=LEVEL-1 
GO  TO  3100 

***RANCH  TO  LIVE  NODE*** 

3200  NODE*=NODE+ 1 

GO  TO  (3210,3220)  FLAGUP ( LEVEL ) 

*  *  *WORK  WITH  VARIABLES  WHICH  ARE  UNBOUNDED*** 

FREE  U 

3210  L=-W ( LEVEL ) +CRITV 
UJ=UJO(L) 

LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

1  MEMI, MEMR, UJ) 

C  SET  A  G  TO  ZERO 

W( LEVEL ) »— W ( LEVEL ) 

L=W( LEVEL) 

UJ=0 . 0 
LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

1  MEMI, MEMR, UJ) 

GO  TO  4000 

C  *  *  *WORK  WITH  VARIABLES  WHICH  ARE  BOUNDED*** 

3220  L=BLVAR+IVARU( LEVEL) 

C  FREE  U 

UJ=UJO(L) 

LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

C  SET  G  TO  ITS  UPPER  BOUND 

W< LEVEL )=-W( LEVEL) 

L=W( LEVEL) 

UJ=UJO(L) 


3236  CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

MEMI , MEMR , U J ) 

C  ***SECTION  SETS  BASIS  AND  STATUS  ARRAYS  USED  BY 

C  XMP  SUBROUTINE  XSTART  WHICH  CAN  START  THE 

C  PRIMAL  SIMPLEX  METHOD  FROM  ANY  GIVEN  BASIS*  *  * 

4000  DO  4001  K=1 , M 
BASIS (K)=OKBAS(K) 

4001  CONTINUE 

DO  4002  K=1 , N 

STATUS ( K ) =OKSTAT ( K ) 

4002  CONTINUE 

C  ***CALLS  XMP  LINEAR  PROGRAMMING  SUBROUTINES*** 

CALL  XSTART ( B , BASCB , BASIS , BASLB , BASUB , 

1  BNDTYP , BOUND , 

2  COLA , COLI , COLMAX , IOERR , 

3  M , MAP I , MAPR , MAXM , MAXN , MEMI , MEMR , 

4  N,NTYPE2,SC0DE, STATUS, 

5  UZERO , XBZERO , Z ) 

C 


4500  CALL 
1 
2 

3 

4 

5 


XPRIML ( B , BASCB , BASIS , BASLB , BASUB , BNDTYP , 
BOUND , COLA , COL I , COLMAX , 

FACTOR , IOERR , IOLOG , ITER1 , ITER2 , 

LOOK , M , MAPI , MAPR , MAXM , MAXN , MEMI , MEMR , 
N , NTYPE2 , PICK , PRINT , STATUS , TERMIN , 
UNBDDQ , UZERO , XBZERO , YQ , Z ) 


C 

C  FLIP  THE  SIGN  OF  THE  OBJECTIVE  FUNCTION  VALUE  IF 

C  PROBLEM  IS  MINIMIZATION. 

ZTEMP=Z 

IF (MINMAX  .EQ.  -1)  ZTEMP=-ZTEMP 


C 

C 


GO  TO  1999 
C 

C  PROBLEM  DOES  NOT  HAVE  AN  OPTIMAL  SOLUTION 

C 

5000  WRITE ( IOLOG, 7000)  TERMIN 

7000  FORMAT ( 1H1/// , 10X, 'THE  PROBLEM  IS  INFEASIBLE  ' 
1  'OR  UNBOUNDED' ,13) 

GO  TO  314 


C 

c 

c 

c 

c 


*  *  *PRINT  OUT  THE  SOLUTION*** 


1 


r 

i 
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CPTIME  IS  A  UTILITY  USED  ON  THE  UNIVERSITY 
OF  TEXAS  IBM  COMPUTER  TO  FIND  CPU  TIME 


oooo  oo  oo  oo 


6000  CALL  CPTIME ( T0TCP2 ,VIRCP2) 
T0TCP=T0TCP2-T0TCP1 
VIRCP=VIRCP2-VIRCP1 
IF  { FLGOUT . EQ . 1 . 0 )  WRITE  (6,1985) 

1985  FORMAT ('THE  ABOVE  SOLUTION  IS  NOT  OPTIMAL. 

1  ' THE  BRANCH  AND  BOUND  TREE  HAS  ' , 

2  'REACHED  ITS  MAX  SIZE') 

CALL  XPRINT ( BESTB , BNDTYP , BOUND , 

1  IOERR , IOLOG , NUMXY , M , 

2  MAPI , MAPR , MAXM , MAXN , MEMI , MEMR , 

3  N , NTYPE2 , BESTAT , XBEST , ZBEST , 

4  UJO , BESTLB , BESTUB ) 


IF  (FLGOUT. EQ. 1.0)  WRITE  (6,1984) 

1984  FORMAT {'THE  ABOVE  SOLUTION  IS  NOT  OPTIMAL.  ', 

1  ' THE  BRANCH  AND  BOUND  TREE  HAS  ' , 

2  'REACHED  ITS  MAX  SIZE') 

WRITE  (6,1988)  NODE , NODBST 

1988  FORMAT ( '  NUMBER  OF  NODES  ',16,'  BEST  NODE  ',16) 

314  CONTINUE 

WRITE  (6,70)  TOTCP , VIRCP 
70  FORMAT (3X, 'TOTAL  CPTIME  =',I6,3X, 

1  'VIRTUAL  CPTIME  =',I6) 

STOP 

END 


1 

2 

3 

4 


SUBROUTINE  XPRINT ( BASIS , BNDTYP , BOUND , 

IOERR , IOLOG , NUMXY , M , 

MAPI , MAPR , MAXM , MAXN , MEMI , 
MEMR , N , NTYPE2 , STATUS , XBZERO , 
Z , UJO , BESTLB , BESTUB ) 


MODIFIED  XMP  SUBROUTINE.  PRINTS  OUT  VALUES  OF 
OF  VARIABLES. 


INTEGER  MAXM, MAXN 

DOUBLE  PRECISION  BOUND , MEMR ( LENR) , XBZERO (MAXM) , Z 
INTEGER  BNDTYP, IOERR, IOLOG, M,N,NTYPE2 
INTEGER  MAPI ( LENMI ), MAPR (LENMR) 

INTEGER  BASIS { MAXM ) , MEMI ( LENI ) , STATUS ( MAXN ) 

C  *****LOCAL  VARIABLES* 


DOUBLE  PRECISION  LJ , UJ , VALUE , BESTLB ( 600 ) , 

1  BESTUB ( 600 ) 

INTEGER  IX ,  J , NUMXY 
*****COMMON  VARIABLES 
COMMON/XMPLEN/LENI , LENMI , LENMR , LENR 
INTEGER  LENI , LENMI , LENMR , LENR 

WRITE (IOLOG, 901) 

901  FORMAT { 1H0 , 28H  XPRINT ...  CURRENT  SOLUTION) 
WRITE ( IOLOG, 902) M,N 

902  FORMAT (1H0,I6,20H  LINEAR  CONSTRAINTS ,, 5X , 16 , 

1  10H  VARIABLES) 

WRITE (IOLOG, 903) 

903  FORMAT ( 1H0 , 2 5H  AN  SB  FOLLOWING  STATUS  , 

1  32HINDICATES  A  SUPER-BASIC  VARIABLE) 

WRITE (IOLOG, 904) 

904  FORMAT ( 1 HO, 1 OH  VARIABLE , 5X , 10H  STATUS, 5X, 

1  15H  VALUE) 

PRINT  OUT  THE  VALUES  OF  ALL  OF  THE  BASIC 
VARIABLES  AND  ALL  OF  THE  NON-BASIC  VARIABLES 
THAT  ARE  AT  NON-ZERO  BOUNDS. 

DO  280  J=l, NUMXY 

IF ( STATUS ( J ) ) 200 , 250 , 260 
200  IF ( STATUS ( J ) . EQ . - 2  .OR.  STATUS ( J ). EQ . -3 ) 

1  GO  TO  230 

IF ( STATUS ( J ) . EQ . -4 ) GO  TO  250 
HERE  FOR  NON-BASIC  VARIABLES  AT  THEIR 
UPPER  BOUNDS. 

IF (BNDTYP.LT. 3) GO  TO  210 
VALUE=BESTUB( J) 

GO  TO  270 

210  IF (BNDTYP.LT. 2) GO  TO  220 

IF ( J . GT . NTYPE2 ) GO  TO  220 
VALUE=BOUND 
GO  TO  270 

220  WRITE( IOLOG, 905)  J 

905  FORMAT (16H  ERROR:  VARIABLE, 16, 

1  16H  IS  AT  ITS  UPPER, 

2  20H  BOUND  OF  +INFINITY.) 

GO  TO  280 

HERE  FOR  FREE  AND  ARTIFICIAL  VARIABLES. 

DO  240  1=1, M 


230 


OO  OOO  O  QO  ooo  oo 


262 


IF ( BASIS ( I )  .NE.  J ) GO  TO  240 
VALUE=XBZER0 ( I ) 

GO  TO  270 

240  CONTINUE 

GO  TO  280 

HERE  FOR  NON-BASIC  VARIABLES  AT  THEIR 
LOWER  BOUNDS. 

250  IF ( BNDTYP  . NE .  4 ) GO  TO  280 

VALUE=BESTLB( J) 

GO  TO  270 

HERE  FOR  THE  BASIC  VARIABLES  (EXCEPT  FREE 

AND  ARTIFICIALS) 

260  IX=STATUS(J) 

VALUE=XBZERO( IX) 

IF ( IX  .LE.  M)G0  TO  270 

HERE  FOR  SUPER-BASIC  VARIABLES. 

WRITE ( IOLOG , 908 ) J , STATUS ( J ) , VALUE 

908  FORMAT ( IX , 110 , 5X, 110 , IX , 2HSB , 2X , D15 . 8 ) 

GO  TO  280 

270  WRITE ( IOLOG , 906 )  J , STATUS ( J ) , VALUE 

906  FORMAT (IX, 110, 5X, 110, 5X , D25 . 12 ) 

280  CONTINUE 

PRINT  THE  OBJECTIVE  VALUE. 

WRITE (IOLOG, 907)  Z 

907  FORMAT ('  VALUE  OF  THE  LINEAR  OBJECTIVE  ' 

1  ' FUNCTION  =  ' ,D15 . 8 ) 


RETURN 

END 


The  codes  for  the  mixed  integer  BLPP  include  a 
random  problem  generator,  a  program  which  can  be  used  to 
input  a  mixed  integer  BLPP,  and  the  algorithms  for  the 
mixed  integer  BLPP.  The  listing  of  the  program  which 
can  be  used  to  input  a  mixed  integer  BLPP  is  presented 
in  section  A . 5 . 2 . 

A. 6.1  The  Mixed  Integer  BLPP  Random  Problem  Generator 

The  listing  below  presents  the  code  which  generates 
a  random  mixed  integer  BLPP.  The  program  calls  the 
random  number  generator  URAND  which  is  presented  in 
section  A. 2.  The  program  requires  nine  inputs.  They 
are 

the  total  number  of  variables  controlled  by  the 
leader ; 

the  total  number  of  variables  controlled  by  the 
follower ; 

the  number  of  integer  variables  controlled  by  the 
leader ; 

the  number  of  integer  varirbles  controlled  by  the 
follower ; 

the  number  of  constraints  with  no  variables 


the  number  of  constraints  with  variables  controlled 
by  the  follower; 

the  maximum  number  of  vertices  allowed  in  the 
branch  and  bound  tree; 

the  maximum  number  of  nonzero  elements  in  a  column 
of  the  A  or  B  matrix; 
the  random  number  seed. 

The  program  is  listed  below. 
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PROGRAM  MIXGEN 


*****PURP0SE 

PROGRAM  GENERATES  RANDOM  LINEAR  MIXED  INTEGER 
BILEVEL  PROGRAMMING  PROBLEMS  (BLPP) .  THE  FUNCTION 
URAND  PROVIDES  RANDOM  NUMBERS.  REFER  TO  THE 
SECTION  ON  THE  FUNCTION  URAND  FOR  MORE 
INFORMATION  AND  A  LISTING  OF  THE  FUNCTION. 


♦♦♦VARIABLE  DEFINITIONS*** 


B 

BNDTYP 


COLA 


COLI 


COLLEN 


CONX 


CONY 


CRITV 


ARRAY  WHICH  CONTAINS  THE  COEFFICIENTS  OF 
EACH  VARIABLE  IN  THE  A-  AND  B-MATRICES  OF 
THE  BLPP. 

THE  RIGHT  HAND  SIDE  ARRAY. 

1  MEANS  LOWER  BOUND=0 ,  UPPER 
BOUND=+ INFINITY  FOR  EVERY  NON-FREE 
VARIABLE ; 

2  MEANS  LOWER  B0UND=0 ,  UPPER  BOUND=BOUND 
FOR  EVERY  NON-FREE  STRUCTURAL  VARIABLE 

3  MEANS  LOWER  B0UND=0  FOR  EVERY  NON-FREE 
VARIABLE ; 

4  MEANS  BOTH  BOUNDS  ARE  GENERAL. 

ARRAY  CONTAINING  THE  LEADER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

ARRAY  CONTAINING  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION  COEFFICIENTS. 

IS  USED  TO  HOLD  THE  NON-ZERO  COEFFICIENTS 
OF  A  MATRIX  COLUMN. 

IS  USED  TO  HOLD  THE  ROW  NUMBERS 
CORRESPONDING  TO  THE  NON-ZEROS  OF  A  MATRIX 
COLUMN . 

THE  NUMBER  OF  NONZEROS  IN  EACH  COLUMN  OF 
THE  A-  AND  B-MATRICES  OF  THE  BLPP. 

NUMBER  OF  CONSTRAINTS  CONTAINING  NO 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER. 

NUMBER  OF  COMPLEMENTARY  SLACKNESS 
CONDITIONS  WHICH  MUST  BE  SATISFIED  IN 
SOLVING  THE  BLPP  IN  ITS  EQUIVALENT  KUHN- 
TUCKER  REPRESENTATION. 

RANDOM  NUMBER  SEED  OF  IY. 

IS  USED  TO  HOLD  THE  LOWER  BOUND  ON  A 
SINGLE  VARIABLE. 


f. 

ft 
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C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


M  NUMBER  OF  CONSTRAINTS  IN  THE  EQUIVALENT 

KUHN-TUCKER  REPRESENTATION  OF  THE  BLPP . 
MAXCOL  MAXIMUM  NUMBER  OF  NONZEROS  IN  ANY  ONE 
COLUMN  OF  THE  BLPP. 

MINMAX  FLAG  INDICATING  NATURE  OF  THE  PROBLEM. 

1  MEANS  MAXIMIZATION;  -1  MEANS 
MINIMIZATION.  FIXED  AT  1  IN  THIS  PROGRAM. 
NSTRUC  NUMBER  OF  VARIABLES  IN  THE  KUHN-TUCKER 

REPRESENTATION  OF  THE  MIXED  INTEGER  BLPP. 
NUMCON  THE  NUMBER  OF  CONSTRAINTS  IN  THE  BLPP. 
NUMITR  THE  MAXIMUM  NUMBER  OF  VERTICES  IN  THE 

BRANCH  AND  BOUND  TREE  CREATED  WHEN  SOLVING 
THE  BLPP. 

NUMX  THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER . 

NUMXY  THE  NUMBER  OF  VARIABLES  IN  THE  BLPP. 

NUMY  THE  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 

FOLLOWER. 

PRINT  AN  XMP  VARIABLE.  SETS  THE  AMOUNT  OF 
OUTPUT  CREATED  BY  XMP.  SEE  THE  XMP 
DICTIONARY  FOR  FURTHER  INFORMATION. 

ROWTYP  ARRAY  WHICH  INDICATES  THE  TYPE  OF 
CONSTRAINT : 

+1  MEANS  LESS  THAN  OR  EQUAL  TO; 

0  MEANS  EQUATION; 

-1  MEANS  GREATER  THAN  OR  EQUAL  TO. 

UJ  IS  USED  TO  HOLD  THE  UPPER  BOUND  ON  A 

SINGLE  VARIABLE. 

UROW  ARRAY  CONTAINS  VALUES  USED  TO  CREATE  THE 

KUHN-TUCKER  STATIONARITY  CONDITIONS  OF  THE 
FOLLOWER'S  PROBLEM. 

VARTYP  INDICATES  VARIABLE  TYPE: 

0  MEANS  A  VARIABLE  IS  REAL  VALUED; 

1  MEANS  A  VARIABLE  IS  INTEGER; 

2  MEANS  A  VARIABLE  IS  BOUNDED  AND  INTEGER; 

3  MEANS  A  VARIABLE  IS  BOUNDED  AND  REAL 
VALUED . 

XINT  NUMBER  OF  INTEGER  VARIABLES  CONTROLLED  BY 
THE  LEADER. 

YINT  NUMBER  OF  INTEGER  VARIABLES  CONTROLLED  BY 
THE  FOLLOWER. 

*  *  *  END  VARIABLE  DEFINITIONS*  *  * 

***NOTE*** 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 


« 


* 

■ 


Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 
U  REFERS  TO  KUHN-TUCKER  MULTIPLIERS  ASSOCIATED 
WITH  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  WITH  THE 
NONNEGATIVE  RESTRICTIONS  ON  THE  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER; 

G  REFERS  TO  THE  SLACK  OR  SURPLUS  VARIABLE 
ASSOCIATED  WITH  EACH  CONSTRAINT  CONTAINING 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

***END  OF  NOTE*  *  * 

REAL  UROW{ 200 , 200) ,C0LA(200) ,B(200) , ACC ( 200 , 200 ) , 

1  CJ1(200) ,CJ2(200) ,UJ,LJ 

INTEGER  CNT , COLI ( 200 ) ,C0LLEN(200) , CONY , CONX , CONXY , 

1  CRITV , PRINT , ECHO , BNDTYP , ROWTYP ( 200 ) , 

2  VARTYP ( 200 ) , XINT , YINT 
CHARACTER *4  DUMY 

A0NE=1 .0 
I0NE=1 
ZER0=0 . 0 
IZER0=0 
DUMY= ' XSUB ' 

***READ  IN  PROBLEM  INFORMATION*** 

READ  (5,*)  NUMX, NUMY, XINT, YINT, CONX, CONY, MAXNDS, 

1  MAXCOL , IY 

MINMAX=1 
ECHO=0 
PRINT=0 
BNDTYP=4 
UJ=200000 . 0 
LJ=0 . 0 

CRITV=NUMY+CONY 
M=NUMY+CONY+CONX 
NUMXY=NUMX+NUMY 
NUMX Y 1 =NUMX Y + 1 

NSTRUC=NUMY+NUMY+CONY+CONY+NUMX 

C0NX1=C0NX+1 

NUMX 1 =NUMX+ 1 

CONXY=CONX+CONY 

IF  (CONX.EQ.O)  GO  TO  105 

♦♦♦COMPUTE  RHS  OF  X  CONSTRAINTS*** 

DO  100  1=1, CONX 

B{ I ) =URAND( IY) *50.0 
100  CONTINUE 


I 
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** ‘COMPUTE  RHS  OF  CONSTRAINTS  WITH  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER*** 

105  DO  110  I=C0NX1 , CONXY 

B { I ) =URAND ( I Y ) *  5  0 . 0 
110  CONTINUE 

♦♦♦DETERMINE  SIGN  OF  CONSTRAINTS 
0.7  <  AND  0.3  >*** 

DO  115  1=1, CONXY 
DUM=URAND(IY) 

ROWTYP ( I ) = 1 

IF  (DUM.LE.0.3)  R0WTYP(I)=-1 
115  CONTINUE 

*  *  * COMPUTE  COEFFICIENTS  OF  LEADER  AND  FOLLOWER 

OBJECTIVE  FUNCTIONS*** 

DO  120  1=1 , NUMXY 

CJ1 ( I ) =URAND ( IY) *50 . 0-25 . 0 
CJ2 ( I ) =URAND ( IY) *50.0-25.0 
120  CONTINUE 

MAXC2=MAXC0L+MAXC0L 

GENERATE  THE  A-  B-MATRICES  OF  THE  BLPP*** 

DO  130  1=1, NUMXY 
IR0W=0 
CNT=0 

IF  (I.GE.NUMX1)  IROW=CONX 
DO  140  J = 1 , M AXC 2 , 2 

YA=URAND (IY)*61. 0-15.0 
ROWNUM=URAND ( IY ) *3 . 0+1 . 0 
I ROW=ROWNUM+ I ROW 

***X  &  Y  COEFFICIENTS  ALLOWED  IN  Y  CONST. 

NO  Y'S  ALLOWED  IN  X  CONST*** 

IF (IROW.GT. CONXY)  GO  TO  145 
ACC ( I , J ) =IR0W 
ACC ( I , J+l ) =YA 
UROW ( I , IROW ) =YA 
CNT=CNT+1 
140  CONTINUE 

145  COLLEN { I ) =CNT 

130  CONTINUE 

*  * ‘RANDOMLY  DETERMINE  WHICH  X  &  Y  VARIABLES 

ARE  INTEGER*** 

INTCNT=0 

PERCNT=FLOAT ( XINT ) /FLOAT ( NUMX ) 

310  DO  300  1=1, NUMX 

IF  ( INTCNT . GE . XINT )  GO  TO  305 
IF  ( VARTYP ( I ) . EQ . 1 )  GO  TO  300 


laoauaiuxi 


I 


W=URAND  ( I Y ) 

IF  (W.GT.PERCNT)  GO  TO  300 
VARTYP ( I ) =1 
INTCNT=INTCNT+1 
300  CONTINUE 

IF  ( INTCNT.LT. XINT)  GO  TO  310 
305  INTCNT=0 

PERCNT=FLOAT { YINT ) /FLOAT ( NUMY ) 

315  DO  320  I=NUMX1 , NUMXY 

IF  ( INTCNT . GE . YINT )  GO  TO  325 
IF  ( VARTYP ( I ) . EQ . 1 )  GO  TO  320 
W=URAND  { I Y ) 

IF  (W.GT.PERCNT)  GO  TO  3  20 
VARTYP ( I ) =1 
NSTRUC=NSTRUC+ 1 
INTCNT=INTCNT+1 
320  CONTINUE 

IF  (INTCNT.LT. YINT)  GO  TO  315 
C  ***WRITE  PROBLEM  INFORMATION*** 

325  WRITE  (6.905)  CRITV , NUMX , NUMY . CONX , CONY , XINT , 

1  YINT , MAXNDS 

905  FORMAT  (815) 

WRITE  (6,908)  M , NSTRUC , MINMAX , ECHO, PRINT, BNDTYP 
908  FORMAT (615) 

C  ***WRITE  CONSTRAINTS  OF  THE  BLPP*** 

DO  150  1=1, CONX 

WRITE  (6,910)  I , ROWTYP ( I ) , B ( I ) 

150  CONTINUE 

DO  155  I=C0NX1 , CONXY 

WRITE  (6,910)  I , IZERO , B ( I ) 

155  CONTINUE 

910  FORMAT (215, FI 3. 3) 

C  ***WRITE  RHS  OF  U-ROWS*** 

DO  160  1=1, NUMY 
K=I+CONXY 
J=I+NUMX 

WRITE  (6,910)  K, IZERO, -CJ2(J) 

160  CONTINUE 

C  *  *  *WRITE  X  VARIABLE  INFO  AND  COLUMNS*** 

DO  230  1=1, NUMX 
ICOLL=COLLEN ( I ) 

WRITE  (6,915)  DUMY , I , ICOLL , C J 1(1), U J , L J , 

1  VARTYP ( I ) 

ICOLL2  =  2  * ICOLL 
DO  235  J=1 , IC0LL2 , 2 
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IB=ACC ( I , J ) 

234  WRITE  (6,920)  IB , ACC ( I , J+l ) 

235  CONTINUE 
230  CONTINUE 

915  FORMAT ( A4 , 215 , F15 . 5 , 2F10 .0,12) 

920  FORMAT ( I 5 , F 1 5 . 5 ) 

C  ***WRITE  Y  VARIABLE  INFO  AND  COLUMNS*** 

DO  170  I=NUMX1 , NUMXY 
ICOLL=COLLEN( I) 

ICOLL2=2*ICOLL 

WRITE  (6,915)  DUMY , I , ICOLL , CJ1 ( I ) , UJ , LJ , 

1  VARTYP ( I ) 

DO  180  J=1 , IC0LL2 , 2 
IB=ACC ( I , J ) 

WRITE  (6,920)  IB , ACC ( I , J+l ) 

180  CONTINUE 
170  CONTINUE 

C  WRITE  G'S  OF  Y  CONSTRAINTS*** 

DO  190  1=1, CONY 
I SEQ=NUMXY + I 

WRITE  (6,915)  DUMY , ISEQ , I ONE , ZERO , UJ , LJ , I ZERO 
IDUM=I+CONX 

AONE= AONE *  ROWTYP ( IDUM ) 

WRITE  (6,920)  IDUM, AONE 
A0NE=1 .0 
190  CONTINUE 

C  *  *  *WRITE  THE  U'S  OF  THE  Y  .GE.  0  CONSTRAINTS*** 

DO  200  1=1 , NUMY 

ISEQ=NUMXY+CONY+I 
IROW= I +CONXY 

WRITE  (6,915)  DUMY, ISEQ, IONE, ZERO, U J , L J , IZERO 
WRITE  (6,920)  IROW,AONE 
200  CONTINUE 

*  *  *WRITE  THE  U'S  WHICH  ARE  KUHN-TUCKER 
MULTIPLIERS  Y  CONSTRAINTS  DERIVED  FROM 
EQUATION 

GRAD(F( Y) ) -U*GRAD ( G ( Y) )=0*** 

DO  210  I=C0NX1 , CONXY 
CNT=0 

DO  215  J=NUMX1 , NUMXY 

IF ( UROW ( J , I ) . EQ . 0 . 0 )  GO  TO  215 
CNT=CNT+1 

COLA(CNT)=-UROW( J, I) 

COLI { CNT ) = J+CONXY-NUMX 
215  CONTINUE 


o  o 
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ISEQ=I+CONY+NUMY+NUMXY-CONX 

WRITE  (6,915)  DUMY, ISEQ,CNT, ZERO, UJ, ZERO, I ZERO 
DO  220  K=1 , CNT 

WRITE  (6,920)  COLI(K) ,C0LA(K) 

220  CONTINUE 
210  CONTINUE 

***WRITE  U'S  WHICH  ARE  FOR  THE  INTEGER  Y'S 
POSSIBLE  UPPER  BOUND*** 
ISEQ=CONY+CONY+NUMY+NUMY+NUMX 
CNT=0 

DO  400  I=NUMX1 , NUMXY 
CNT=CNT+1 

IF  ( VARTYP ( I ) . EQ • 0 )  GO  TO  400 
ISEQ=ISEQ+1 

WRITE  (6,915)  DUMY, I SEQ, I ONE, ZERO, UJ, ZERO, I ZERO 
IROW=CONXY+CNT 
WRITE  (6,920)  IROW,-AONE 
400  CONTINUE 
STOP 
END 
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A. 6. 2  The  Algorithms  for  the  Mixed  Integer  BLPP 

The  following  program  is  the  computerized  version 
of  Algorithm  1  presented  in  Chapter  6.  The  program  is 
documented  to  show  where  modifications  are  made  to 
create  Algorithms  2  through  8.  The  XMP  variables  are 
defined  in  section  A. 4.  The  variables  local  to  the  main 
program  are  defined  in  the  code.  In  line  documentation 
is  also  included.  The  program  is  listed  below. 


J 
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PROGRAM  BLPPM1 
**** ‘PURPOSE: 

THIS  IS  THE  PROGRAM  WHICH  READS  IN  THE  MIXED 
INTEGER  BILEVEL  PROGRAMMING  PROBLEM  AND  SOLVES 
IT  USING  A  BRANCH  AND  BOUND  PROCEDURE.  THIS 
PROGRAM  USES  THE  SUBROUTINE  LIBRARY  XMP  TO  SOLVE 
THE  SUBPROBLEMS  WHICH  ARE  CREATED  IN  THE  BRANCH 
AND  BOUND  TREE.  XMP  IS  DESIGNED  TO  SOLVE  LINEAR 
PROGRAMMING  PROBLEMS  USING  THE  PRIMAL  OR  DUAL 
SIMPLEX  METHOD. 

THIS  PROGRAM  READS  THE  PROBLEM  DATA  INTO  XMP 
COMPATIBLE  ARRAYS.  IT  THEN  SOLVES  THE  LINEAR 
MIXED  INTEGER  BILEVEL  PROGRAMMING  PROBLEM  USING 
THE  XMP  SUBROUTINE  LIBRARY.  EACH  SUBPROBLEM  IS 
SOLVED  USING  THE  PRIIMAL  SIMPLEX  METHOD. 

THIS  PROGRAM  IS  A  GENERAL  PURPOSE  FRONT  END  FOR 
READING  IN  AND  SOLVING  A  LINEAR  MIXED  INTEGER 
BILEVEL  PROGRAMMING  PROBLEM.  IT  DOES  NOT 
TAKE  ANY  ADVANTAGE  OF  SPECIAL  PROBLEM  TYPE  OR 
STRUCTURE.  FOR  MOST  SERIOUS  APPLICATIONS  YOU  WILL 
WANT  TO  WRITE  A  MATRIX  GENERATOR  THAT  READS  IN 
DATA  TABLES  AND  GENERATES  THE  LP  COEFFICIENT 
MATRIX  ONE  COLUMN  AT  A  TIME.  THE  FORTRAN  PROGRAM 
BLPPREAD  CAN  BE  USED  TO  READ  IN  AND  CONVERT  THE 
DATA  OF  A  MIXED  INTEGER  BLPP  TO  A  FORM  COMPATIBLE 
WITH  THIS  PROGRAM. 

*****DICTI0NARY  OF  VARIABLES***** 

XMP  VARIABLES — FOR  DEFINTIQNS  SEE  THE 
XMP  DICTIONARY 

VARIABLES  USED  IN  BLPP  BRANCH  AND  BOUND 

BBTBIG  CONTAINS  VALUE  OF  BIGGEST  PRODUCT  IN  TEST 
FOR  SELECTION  OF  THE  BRANCHING  VARIABLE. 
BBITER  TOTAL  NUMBER  OF  VERTICES  CREATED  IN 

SOLVING  THE  RELAXED  BLPP  AT  EACH  VERTEX  OF 
THE  MIXED  INTEGER  BRANCH  AND  BOUND  TREE. 
BBTEMP  CONTAINS  VALUE  OF  PRODUCT  IN  TEST 

FOR  SELECTION  OF  THE  BRANCHING  VARIABLE. 
BBVAR  AN  ARRAY  WHICH  CONTAINS  THE  VALUES  OF 
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BESTAT 


BESTB 


BESTLB 


BESTLO 


BESTUB 


BESTUP 


BIBEST 


BIBLO 


BIBSTB 


BIBUP 


BIFEAS 


BILEV 


THE  VARIABLES  AT  THE  CURRENT  VERTEX  OF 
THE  BRANCH  AND  BOUND  TREE  OF  THE  RELAXED 
BLPP  . 

IS  THE  STATUS  OF  EACH  VARIABLE  IN  THE 
INCUMBENT  SOLUTION  OF  THE  MIXED  INTEGER 
BLPP.  REFER  TO  THE  XMP  DICTIONARY  FOR  A 
DEFINITION  OF  STATUS. 

IS  THE  LIST  OF  BASIC  VARIABLES  IN  THE 
INCUMBENT  SOLUTION  OF  THE  MIXED  INTEGER 
BLPP. 

ARRAY  WHICH  CONTAINS  THE  LOWER  BOUNDS  ON 
THE  VARIABLES  IN  THE  SOLUTION  OF  THE 
RELAXED  BLPP. 

ARRAY  WHICH  CONTAINS  THE  LOWER  BOUNDS  ON 
THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION 
OF  THE  MIXED  INTEGER  BLPP. 

ARRAY  WHICH  CONTAINS  THE  UPPER  BOUNDS  ON 
THE  VARIABLES  IN  THE  SOLUTION  OF  THE 
RELAXED  BLPP. 

ARRAY  WHICH  CONTAINS  THE  UPPER  BOUNDS  ON 
THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION 
OF  THE  MIXED  INTEGER  BLPP. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  THE  ARRAY  CONTAINS  THE  VALUES 
OF  THOSE  VARIABLES  WHICH  ARE  BASIC  IN  THE 
INCUMBENT  SOLUTION  OF  THE  MIXED  INTEGER 
PROBLEM. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  ARRAY  CONTAINS  THE  LOWER  BOUNDS 
ON  THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION 
OF  THE  MIXED  INTEGER  PROBLEM. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  ARRAY  CONTAINS  A  LIST  OF  BASIC 
VARIABLES  IN  THE  INCUMBENT  SOLUTION  OF  THE 
MIXED  INTEGER  PROBLEM. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  ARRAY  CONTAINS  THE  UPPER  BOUNDS 
ON  THE  VARIABLES  IN  THE  INCUMBENT  SOLUTION 
OF  THE  MIXED  INTEGER  PROBLEM. 

FLAG  USED  TO  INDICATE  WHEN  THE  SOLUTION 
OF  THE  RELAXED  BLPP  IS  A  SOLUTION  OF  THE 
MIXED  INTEGER  BLPP.  0  MEANS  TRUE  AND 
1  MEANS  FALSE. 

CONTAINS  THE  LEVEL  OF  THE  CURRENT  VERTEX 
IN  FOLLOWER'S  MIXED  INTEGER  BRANCH  AND 
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BILO 


BIPLOR 


BISEP 


BISTAT 


BIUP 


BIZBST 


BLVAR 


BSTNOD 


CONX 


CONY 


CRITV 


DONEIT 


DUMCNT 


BOUND  TREE. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  STORES  THE  LOWER  BOUND  OF  THE 
SEPARATION  VARIABLE  AT  EACH  LEVEL  OF  THE 
BRANCH  AND  BOUND  TREE. 

ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  THE  ARRAY  INDICATES  IF  THE 
ALTERNATIVE  VERTEX  AT  EACH  LEVEL  OF  THE 
MIXED  INTEGER  BRANCH  AND  BOUND  TREE  HAS 
BEEN  EXPLORED.  0  MEANS  ALTERNATIVE  NOT 
EXPLORED  AND  1  MEANS  ALTERNATIVE  EXPLORED. 
ARRAY  USED  IN  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  THE  ARRAY  TRACKS  THE  SEPARATION 
VARIABLE  AT  EACH  LEVEL  OF  THE  BRANCH  AND 
BOUND  TREE  OF  THE  MIXED  INTEGER  PROBLEM. 
ARRAY  USED  IN  THE  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  THE  ARRAY  CONTAINS  THE  STATUS  OF 
EACH  VARIABLE  IN  THE  INCUMBENT  SOLUTION  OF 
THE  MIXED  INTEGER  PROBLEM.  REFER  TO  THE 
XMP  DICTIONARY  FOR  A  DEFINITION  OF  STATUS. 
ARRAY  USED  IN  THE  FOLLOWER'S  MIXED  INTEGER 
PROBLEM.  STORES  THE  UPPER  BOUND  OF  THE 
SEPARATION  VARIABLE  AT  EACH  LEVEL  OF  THE 
BRANCH  AND  BOUND  TREE. 

VALUE  OF  INCUMBENT  SOLUTION  OF  THE 
FOLLOWER'S  MIXED  INTEGER  PROBLEM. 

POINTS  TO  POSITION  WHERE  KUHN-TUCKER 
MULTIPLIERS  OF  UPPER  BOUND  ON  VARTYP  =  3 
VARIABLES  IS  FOUND  IN  BBVAR . 

VERTEX  AT  WHICH  INCUMBENT  SOLUTION  OF  THE 
MIXED  INTEGER  BLPP  IS  FOUND. 

ARRAY  WHICH  STORES  THE  COEFFICIENTS  OF  THE 
LEADER'S  OBJECTIVE  FUNCTION. 

NUMBER  OF  CONSTRAINTS  WHICH  DO  NOT  CONTAIN 
ANY  VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 
NUMBER  OF  CONSTRAINTS  WHICH  CONTAIN 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

IS  THE  NUMBER  OF  COMPLEMENTARY  SLACKNESS 
CONDITIONS  WHICH  MUST  BE  SATISFIED  BY 
BY  THE  SOLUTION  OF  THE  BLPP. 

USED  AS  A  FLAG  TO  INDICATE  COMPLETION  OF 
MIXED  INTEGER  BRANCH  AND  BOUND  PROCESS. 

0  MEANS  NOT  DONE  AND  1  MEANS  DONE. 

USED  TO  KEEP  TRACK  OF  WHEN  AN  UPPER 
BOUNDED  VARIABLE  IS  BRANCHED  ON  IN  THE 
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.V.'AWf /■/) 


FIXBAS 


FIXSTA 


FIXZER 


INTNOD 


IVARU 


LEVEL 


LOWER 


LOWLY 


MAXNDS 


NODE 


NODBST 


NSTOPV 


NUMX 


NUMXY 


NUMY 


OKBAS 


INTLEV 


RELAXED  BLPP . 

IS  THE  LIST  OF  BASIC  VARIABLES  IN  THE 
SOLUTION  OF  THE  RELAXED  BLPP. 

IS  THE  STATUS  OF  EACH  VARIABLE  IN  THE 
SOLUTION  OF  THE  RELAXED  BLPP.  REFER  TO 
THE  XMP  DICTIONARY  FOR  A  DEFINITION  OF 
THE  STATUS  ARRAY. 

THE  ARRAY  CONTAINING  THE  VALUES  OF  THOSE 
VARIABLES  WHICH  ARE  BASIC  IN  THE  INCUMBENT 
SOLUTION  OF  THE  RELAXED  BLPP. 

CONTAINS  THE  LEVEL  OF  THE  CURRENT  VERTEX 
OF  THE  MIXED  INTEGER  BLPP  BRANCH  AND 
BOUND  TREE. 

NUMBER  OF  VERTEXS  IN  MIXED  INTEGER  BLPP 
BRANCH  AND  BOUND  TREE. 

USED  TO  KEEP  TRACK  OF  WHICH  UPPER  BOUNDED 
VARIABLE  IS  BRANCHED  ON  AT  EACH  . 

CONTAINS  THE  LE,rEL  OF  THE  CURRENT  VERTEX 
OF  THE  RELAXED  BLPP  BRANCH  AND  BOUND  TREE. 
AN  ARRAY  WHICH  KEEPS  TRACK  OF  THE  LOWER 
BOUND  ON  AN  INTEGER  VARIABLE  AT  EACH  LEVEL 
OF  THE  MIXED  INTEGER  BRANCH  AND  BOUND 
TREE. 

ARRAY  WHICH  STORES  LOWER  BOUNDS  ON  THE 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

USED  IN  SECTION  WHICH  DETERMINES  IF 
CURRENT  VERTEX  IN  BRANCH  AND  BOUND  TREE 
CAN  BE  FATHOMED  THROUGH  BOUNDING. 

MAXIMUM  NUMBER  OF  VERTICES  ALLOWED  IN  THE 
BRANCH  AND  BOUND  TREE  OF  THE  MIXED  INTEGER 
BLPP. 

COUNTS  NUMBER  OF  VERTICES  IN  THE  BRANCH 
AND  BOUND  TREE. 

STORE  VERTEX  AT  WHICH  INCUMBENT  SOLUTION 
FOUND . 

COUNTER  USED  IN  LOOP  USED  TO  SELECT  THE 
VARIABLE  ON  WHICH  TO  BRANCH. 

NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
LEADER. 

NUMBER  OF  VARIABLES  IN  THE  MIXED  INTEGER 
BLPP  . 

NUMBER  OF  VARIABLES  CONTROLLED  BY  THE 
FOLLOWER. 

ARRAY  WHICH  STORES  THE  MOST  CURRENT 
FEASIBLE  BASIS. 
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OKSTAT 


PAIR 


RANK 


SEPVAR 


SETU 


UPLY 


UPPER 


VARTYP 


VCNT 


VXPLOR 


ARRAY  WHICH  STORES  STATUS  OF  EACH  VARIABLE 
IN  THE  MOST  CURRENT  FEASIBLE  BASIS. 

AN  ARRAY  USED  TO  TRACK  THE  THE  KUHN-TUCKER 
MULTIPLIERS  ASSOCIATED  WITH  UPPER  BOUNDS 
ON  AN  INTEGER  VARIABLE. 

AN  ARRAY  USED  TO  STORE  THE  INTEGER 
VARIABLES  IN  A  SPECIFIED  ORDER. 

IS  AN  ARRAY  WHICH  INDICATES  WHICH 
VARIABLE  ARE  BRANCHED  ON  IN  THE  MIXED 
INTEGER  BLPP .  A  NEGATIVE  VALUE  MEANS  THE 
VARIABLE  HAS  HAD  LOWER  BOUND  PLACED  ON 
IT,  AND  A  POSITIVE  VALUE  MEANS  A  VARIABLE 
HAS  HAD  A  UPPER  BOUND  PLACED  ON  IT. 

ARRAY  USED  TO  INDICATE  WHICH  KUHN-TUCKER 
MULTIPLIERS  ARE  ASSOCIATED  WITH  INTEGER 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER  AND 
MUST  BE  USED  IF  THEY  BECOME  UPPER  BOUNDED 
IN  THE  TREE. 

ARRAY  WHICH  STORES  THE  UPPER  BOUNDS  OF 
VARIABLES  WHICH  HAVE  UPPER  BOUNDS. 

ARRAY  WHICH  STORES  UPPER  BOUNDS  ON  THE 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

USED  IN  SECTION  WHICH  DETERMINES  IF 
CURRENT  VERTEX  IN  BRANCH  AND  BOUND  TREE 
CAN  BE  FATHOMED  THROUGH  BOUNDING. 

AN  ARRAY  WHICH  KEEPS  TRACK  OF  THE  UPPER 
BOUND  ON  AN  INTEGER  VARIABLE  AT  EACH  LEVEL 
OF  THE  MIXED  INTEGER  BRANCH  AND  BOUND 
TREE. 

INDICATES  THE  VARIABLE  TYPE. 

0  MEANS  A  VARIABLE  IS  REAL  VALUED; 

1  MEANS  A  VARIABLE  IS  INTEGER  VALUED; 

2  MEANS  A  VARIABLE  HAS  AN  UPPER  BOUND  AND 
IS  INTEGER  VALUED; 

3  MEANS  A  VARIABLE  HAS  AN  UPPER  BOUND  AND 
IS  REAL  VALUED. 

A  COUNT  ON  NUMBER  OF  VARIABLES  WHICH  ARE 
NOT  UNBOUNDED  REAL  VALUED  VARIABLES 
( VARTYP  =  0 )  . 

AN  ARRAY  WHICH  INDICATES  IF  THE 
ALTERNATIVE  VERTEX  AT  EACH  LEVEL  OF  THE 
MIXED  INTEGER  BLPP  BRANCH  AND  BOUND  TREE 
HAS  BEEN  EXPLORED.  0  MEANS  ALTERNATIVE 
NOT  EXPLORED  AND  1  MEANS  ALTERNATIVE 
EXPLORED . 
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W  IS  AN  ARRAY  WHICH  INDICATES  WHICH 

COMPLEMENTARY  SLACKNESS  CONDITIONS  HAVE 
BEEN  FORCED  TO  BE  SATISFIED  IN  THE  BRANCH 
AND  BOUND  TREE  OF  THE  RELAXED  BLPP .  A 
NEGATIVE  VALUE  MEANS  THE  KUHN-TUCKER 
MULTIPLIER  IS  SET  TO  ZERO,  AND  A 
POSITIVE  VALUE  MEANS  A  CONSTRAINT  IS 
FORCED  TO  BE  TIGHT. 

WORK  A  WORKING  ARRAY. 

XBEST  THE  ARRAY  CONTAINING  THE  VALUES  OF  THOSE 

VARIABLES  WHICH  ARE  BASIC  IN  THE  INCUMBENT 
SOLUTION  OF  THE  MIXED  INTEGER  BLPP. 

XINT  NUMBER  OF  INTEGER  VARIABLE  CONTROLLED  BY 
THE  LEADER. 

YCJ  THE  ARRARY  CONTAINING  THE  COEFFICENTS  OF 

THE  VARIABLES  IN  THE  FOLLOWER'S  OBJECTIVE 
FUNCTION. 

YINT  NUMBER  OF  INTEGER  VARIABLE  CONTROLLED  BY 
THE  FOLLOWER. 

ZBEST  VALUE  OF  THE  INCUMBENT  SOLUTION  OF  THE 
MIXED  INTEGER  BLPP. 

ZMOST  VALUE  OF  THE  SOLUTION  OF  THE  RELAXED  BLPP. 

*****END  OF  DEFINITIONS***** 


*  *  *  *  *NOTE*  *  *  *  * 

X  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  LEADER; 

Y  REFERS  TO  VARIABLES  CONTROLLED  BY  THE  FOLLOWER; 

U  REFERS  TO  KUHN-TUCKER  MULTIPLIERS  ASSOCIATED 
WITH  CONSTRAINTS  CONTAINING  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER  AND  WITH  THE 
NONNEGATIVE  RESTRICTIONS  ON  THE  VARIABLES 
CONTROLLED  BY  THE  FOLLOWER; 

G  REFERS  TO  THE  SLACK  OR  SURPLUS  VARIABLE 
ASSOCIATED  WITH  EACH  CONSTRAINT  CONTAINING 
VARIABLES  CONTROLLED  BY  THE  FOLLOWER. 

**#**END  of  NOTE***** 

SUMMARY  OF  INPUT  FORMATS: 

CRITV , NUMX , NUMY , CONX , CONY , XINT , YINT , MAXNDS  815 
M,NSTRUC ,MINMAX, ECHO , PRINT, BNDTYP  615 

(I,  ROWTYP ( I )  ,  B( I ) )  1=1, M  215, FI  3. 3 


ooo  o  oooooooo  oo 
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XSUB , J , COLLEN , C J , U J , L J , 

VARTYP(J)  A4,2I5,F15.5,2F10.0,I2 


(I,  A( I , J ) )  FOR  I  WITH  A(I.J)  NONZERO  I5.F15.5 


INTEGER  T0TCP1 , VIRCP1 , T0TCP2 , VIRCP2 , TOTCP , 
1  VIRCP , VARCP 


*****DECLARE  XMP  VARIABLES 

DOUBLE  PRECISION  B ( 1 00 ) , BASCB ( 100 ) , BASLB ( 100 ) , 

1  BASUB( 100) , BOUND, C  J , COLA (50) , 

2  L J , MEMR ( 6000 ) , UJ , UZERO ( 100) , 

3  XBZERO( 100) , YQ( 100) ,Z 


IF  YOU  HAVE  ANY  TWO-SIDED  CONSTRAINTS  (R0WTYP=2), 
THEN  DIMENSION  BLOW ( MAXM ) ,  THE  SAME  AS  B(MAXM). 
OTHERWISE,  JUST  DIMENSION  BLOW(l). 

NOTE:  THIS  VERSION  OF  XDEMO  DOES  NOT  ALLOW 

TWO-SIDED  CONSTRAINTS. 

DOUBLE  PRECISION  BLOW(l) 


INTEGER  ARRAYS  AND  VARIABLES. 

INTEGER  BNDTYP , COLLEN , COLMAX , ERROR , 

1  FACTOR, IOERR,IOLOG, ITER, ITER1 , 

2  ITER2 , LOOK , M , MAPI ( 9 ) , MAPR ( 8 )  , 

3  MAXA , MAXM , MAXN , N , NTYPE2 , PICK , 

4  PRINT, TERMIN.UNBDDQ 
INTEGER  MEMI ( 6000 ) 

INTEGER  BASIS ( 100) ,C0LI ( 50) ,ROWTYP( 100) , 
1  STATUS (600) 


DOUBLE  PRECISION  C JTEMP , ZTEMP , UTEMP 
INTEGER  ECHO , IOIN , ISEQ , JSEQ , JSEQ2 , NSTRUC , MINMAX 
CHARACTER* 4  DUMY 
CHARACTER* 4  XSUB 


*****DECLARE  VARIBLES  NEEDED  FOR  BLPP  BRANCH 
AND  BOUND 

DOUBLE  PRECISION  BBVAR ( 1 00 ) , XBEST ( 100 ) , ZBEST , 

1  BTEMP, BBTBIG, WORK ( 600) , 

2  BIGINT,UPLY( 100) ,LOWLY( 100) , DIFF 


Ul  4  U  N  H  CO  to 
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INTEGER  LEVEL , CRITV , W( 100) ,BESTB( 100) ,BESTAT( 600) , 
1  RANK (100) , L , IX , BBITER , NUMX , NUMY , 

CONX , CONY , NSTOPV , NUMX1 , NUMXY , FLGUP , 

FIXBAS( 100) , FIXSTA( 600 ) , BLVAR , CCNXY , 

BSTCP , BSTNOD 

DOUBLE  PRECISION  UPPER ( 999 ), LOWER ( 999 ), ZMOST . 

BBTEM1 , BBTEM2 , BESTLO ( 600 ) , 

BESTUP ( 600 ) , FIXZER( 100 ) , 

BESTLB ( 600 ) , BESTUB ( 600 ) , C J1 ( 600 ) , 
UJO ( 600 ) , SETU ( 100) ,YCJ(600) , 

ZBND (0:999) 

INTEGER  DONEIT , INTLEV , DUMCNT , IVARU ( 100 ) , 

1  VARTYP ( 600 ) , SEPVAR ( 999 ) ,VCNT,PAIR( 100) , 

2  FLAGUP (100),  OKBAS (100), OKSTAT ( 600 ) , XINT , 

3  YINT 

*****XMP  COMMON  VARIABLES 
COMMON / XMPCOM / BIG , SMALL , ZL , ZLC , 

1  EPS1 , EPS2 , EPS3 , EPS4 , EPS5 , EPS6 

DOUBLE  PRECISION  BIG , SMALL , ZL , ZLC , 

1  EPS1 , EPS2 , EPS3 , EPS4 , EPS5 , EPS6 

COMMON / XMPLEN / LEN I , LENMI , LENMR , LENR 
INTEGER  LENI , LENMI , LENMR , LENR 


DATA  XSUB/’XSUB’/ 

***** SUBROUTINES  CALLED 

XMAPS , XADDAJ , XADDUB , XSLACK , XSTART 

XPRIML , XPRINT , FIXINT 


*****BODY  OF  PROGRAM  (BLPPM1) 

IOIN  IS  LOCAL  TO  THIS  USER  PROGRAM.  IT  SPECIFIES 
THE  I/O  UNIT  FROM  WHICH  THE  DATA  IS  TO  BE  READ. 
IOERR  AND  IOLOG  ARE  XMP  VARIABLES.  IOERR  IS  THE 
I/O  UNIT  WHERE  ERROR  MESSAGES  ARE  TO  BE  WRITTEN. 
IOLOG  IS  THE  I/O  UNIT  WHERE  LOG  INFORMATION  IS  TO 
BE  WRITTEN,  IF  REQUESTED. 

I0IN=5 

I0ERR=6 

I0L0G=6 

*  *  *PRINT  HEADING*** 
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WHITE ( IOLOG ,917) 

917  FORMAT (1H1///10X, 'LINEAR  MIXED  INTEGER  BILEVEL  ' 
1  'PROGRAMMING  PROBLEM') 

*  *  *SET  XMP  VARIABLES*  *  * 

MAXA= 1500 
MAXM— 100 
MAXN=600 
C0LMAX=50 

PICK=6 

LOOK=200 

FACT0R=50 

LENI=6000 

LENR=6000 

LENMI=9 

LENMR=8 

***READ  INFORMATION  ON  MIXED  INTEGER  BLPP*** 
READ ( IOIN , 899 )  CRITV , NUMX , NUMY , CONX , CONY , XINT , 

1  YINT , MAXNDS 

899  FORMAT (815) 


READ ( IOIN , 900 )  M , NSTRUC , MINMAX , ECHO , PRINT , BNDTYP 
900  FORMAT (615) 

C  ***INITIALIZE  BRANCH  AND  BOUND  VARIABLES*** 

NUMINT=XINT+YINT 
NUMXY =NUMX+NUMY 
NUMXY 1 =NUMXY + 1 
NUMX 1 =NUMX+ 1 
C0NXY=C0NX+C0NY 
NSTOPV=CRITV+NUMX 
BLVAR=NUMX+NUMY+CONY+NUMY+CONY 
ZBEST=- 1 . 0D24 
ZM0ST=-1 . 0D24 
DONEIT=0 
INTLEV=0 
BBITER=0 
INTN0D=0 
LEVEL=0 

DO  1199  J=l, NSTRUC 
SETU ( J ) =0 . 0 
1199  BBVAR( J ) =0 . 0 


DO  1198  J=1  , NSTOPV 
1198  W(J)=0 

IF(MINMAX  .EQ.  1 ) WRITE ( IOLOG , 960 ) 

IF(MINMAX  .EQ.  -1 )WRITE( IOLOG , 961 ) 

960  FORMAT ( 1H0, 10X, 26HTHIS  IS  A  MAXIMIZATION  RUN//) 

961  FORMAT ( 1H0, 10X, 26HTHIS  IS  A  MINIMIZATION  RUN//) 

WRITE ( IOLOG , 918) M 

918  FORMAT ( 1H0 , 5X , 16 , 2X , 1 1HC0NSTRAINTS ) 

WRITE ( IOLOG ,919) NSTRUC 

919  FORMAT { 1H0 , 5X , 1 6 , 2X , 20HSTRUCTURAL  VARIABLES//) 
WRITE  (6,920)  NUMX , NUMY , CONX , CONY 

920  FORMAT ('  NUMBER  OF  VARIABLES  CONTROLLED  BY  THE  ' 

1  'LEADER  ',13,/'  NUMBER  OF  VARIABLES 

2  'CONTROLLED  BY  THE  FOLLOWER  ',13,/ 

3  '  NUMBER  OF  CONSTRAINTS  WITH  NO', 

4  '  FOLLOWER  VARIABLES  ',13,/ 

5  '  NUMBER  OF  CONSTRAINTS  WITH  FOLLOWER  ' , 

6  'VARIABLES  ',13) 


C 

C 

C 

C 


C 


CALL  XMAP  S ( BNDTYP , I OERR , MAP I , MAPR , MAXA , 

1  MAXM , MAXN , MEM I , MEMR ) 

READ  IN  THE  ROW  TYPES  AND  THE  RIGHT-HAND-SIDE. 
ISEQ  IS  THE  ROW  NUMBER,  FOR  THE  USER'S 
CONVENIENCE . 

NOSX=NUMX 
DO  100  1=1, M 

READ ( IOIN , 902 )  ISEQ , ROWTYP ( I ) ,B(I) 

IF  ( I . LE . CONXY) GO  TO  100 

N0SX=N0SX+1 

YCJ(NOSX) =-B( I ) 

100  CONTINUE 

902  FORMAT ( 2 I 5 , F 1 3 . 3 ) 

IF ( ECHO  .LT.  1 ) GO  TO  110 
WRITE (IOLOG, 913) 

913  FORMAT ( / / / 1 OX , 7HR0W  NO . , 10X , 8HR0W  TYPE,10X, 

1  16H  RIGHT-HAND-SIDE/) 

DO  105  1=1, M 

WRITE ( IOLOG ,914)  I , ROWTYP ( I ) , B ( I ) 

105  CONTINUE 

914  FORMAT (10X,I7,10X,I8,10X,D16.8 ) 

110  CONTINUE 
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C 

C  N  IS  THE  CURRENT  NUMBER  OF  VARIABLES. 

C  N  IS  INCREMENTED  BY  XADDAJ  AS  EACH  COLUMN 

C  IS  ADDED. 

N=0 

JSEQ2=0 

C 

C  *  *  *READ  IN  THE  COLUMNS  ONE  AT  A  TIME*** 

C 

C  JSEQ  IS  A  SEQUENCE  NUMBER  FOR  THE  USER'S 

C  CONVENIENCE 

C  (XMP  NUMBERS  THE  COLUMNS  SEQUENTIALLY  AS  THEY  ARE 

C  SENT  TO  XADDAJ  AND  RETURNS  THIS  NUMBER  IN  IDNO) 

C 

INTCNT=0 

DO  120  J=1 , NSTRUC 

READ ( IOIN , 904 )  DUMY , JSEQ , COLLEN , C J , UJ , L J , 

1  VARTYP ( J ) 

904  FORMAT (A4, 215, F15. 5, 2F10. 0,12) 

UJO( J)=UJ 

CJ1 ( J) =CJ 
WORK( J) =CJ 

IF ( DUMY  .EQ.  XSUB) GO  TO  1105 
WRITE { IOERR ,901) JSEQ2 

901  FORMAT (31H  ERROR  IN  INPUT  FILE  AFTER  XSUB, 15) 

STOP 

1105  JSEQ2=JSEQ 

IF  ( JSEQ.LT.NUMX1  .OR.  VARTYP ( J ). EQ . 0 
1  .OR.  VARTYP( J) .EQ. 3)  GO  TO  789 

INTCNT=INTCNT+1 
PAIR ( J ) =BLVAR+INTCNT 

IF  ( VARTYP ( J ) . EQ . 1 )  SETU ( BLVAR+INTCNT ) =1 . 0 
789  IF  ( JSEQ . LE . NUMXY )  BLPPCT=BLPPCT+COLLEN 

FLIP  THE  SIGN  OF  THE  OBJECTIVE  FUNCTION 
COEFFICIENT  IF  WE  ARE  MINIMIZING. 

CJTEMP=CJ 

IF { MINMAX  .EQ.  -1)  CJTEMP=-CJ 
DO  130  K=l, COLLEN 

READ( IOIN, 905)  COLI ( K) , COLA ( K ) 

130  CONTINUE 

905  FORMAT ( 15 ,F15 . 5) 

C 

CALL  XADDAJ ( C JTEMP , COLA , COLI , COLLEN , COLMAX , 

1  IOERR, IDNO, MAPI , MAPP , MEMI ,MEMR,N) 

C 


noon 
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IF ( BNDTYP  .GT.  1)G0  TO  112 
LJ=0 . 0 
UJ=BIG 
GO  TO  115 

112  IF { BNDTYP  . GT .  2 ) GO  TO  113 
ERROR=3 

CALL  XSTOP( ERROR, IOERR) 

113  IF ( BNDTYP  . EQ .  3)  LJ=0.0 
C 

IF  ( IDNO . GT . BLVAR  .AND.  SETU ( IDNO ) . EQ . 1 . 0 } 

1  UJ=0 . 0 

CALL  XADDUB  { BNDTYP , IOERR , IDNO , LJ , MAPI , MAPR , 
1  MEMI , MEMR , U J ) 

C 

115  IF ( ECHO  .LT.  l)GO  TO  120 

WRITE( IOLOG, 915) IDNO, CJ,UJ,LJ 

915  FORMAT ( /IX , 2HJ= , 15 , 5X , 3HCJ= , D16 . 8 , 5X , 

1  3HUJ= , D16 . 8 , 5X , 3HLJ= , D16 . 8 ) 

DO  118  K=1 , COLLEN 

WRITE (IOLOG, 916)  COLI(K) ,COLA(K) 

118  CONTINUE 

916  FORMAT (13X,I6,5X,D16.8) 

120  CONTINUE 

***RANK  ORDERS  THE  INTEGER  VARIABLES  ACCORDING 
TO  THEIR  COEFFICIENT  IN  THE  LEADER'S 
OBJECTIVE  FUNCTION*  *  * 

K=1 

150  BIGINT=-1 . 0D20 
DO  155  1=1 , NUMXY 

IF  ( VARTYP ( I ) . EQ . 0  .OR.  VARTYP ( I ) . EQ . 3 ) 

1  GO  TO  155 

IF  (WORK(I) .LE.BIGINT)  GO  TO  155 
RANK ( K ) =1 
BIGINT=WORK( I ) 

155  CONTINUE 

WORK ( RANK ( K ) )=-l .0D25 
K=K+ 1 

IF  (K.GT.NUMINT)  GO  TO  160 
GO  TO  150 
160  CONTINUE 

DO  161  1=1 , NUMINT 

WRITE  (6,162)  RANK (I), I 
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C 

C 

C 


*  *  * START  ALL  OF  THE  STRUCTURAL  VARIABLES  AT  THEIR 
LOWER  BOUNDS*  *  * 

DO  170  J=1,N 
STATUS ( J ) =0 
170  CONTINUE 


CALL  XSLACK ( B , BASCB , BAS I S , BASLB , B ASUB , BLOW , 

1  BNDTYP , BOUND , 

2  COLA , COLI , COLMAX , IOERR , 

3  M , MAP I , MAPR , MAXM , MAXN , MEMI , 

4  MEMR , N , ROWTYP , STATUS , 

5  UZERO , XBZERO , Z ) 


CALL  CPTIME ( T0TCP1 , VIRCP1 
CNT=1 .0 
GO  TO  4500 


•♦•BEGIN  BRANCH  AND  BOUND*** 

1998  CALL  FIXINT ( ZMOST , ZBEST , NUMX , NUMY , VARTYP , U JO , 

YC J , LOWER , UPPER , XBEST , BESTB , BESTAT , 
BESTLO , BESTUP , SEPVAR , DONEIT , PAIR , 
BLVAR , NUMXY , NUMX1 , C J 1 , INTNOD , RANK , 
NUMINT , BESTUB , BESTLB , CONX , CONY , 
NSTRUC , INTLEV , BSTCP , BSTNOD , B , BASCB , 
FIXBAS , BASLB , BASUB , BLOW , ROWTYP , 
BNDTYP , BOUND , COLA , COLI , COLMAX , 

I OERR , M , MAP I , MAPR , MAXM , MAXN , 

MEMI , MEMR , N , NTYPE2 , SCODE , FIXSTA , 
UZERO , FIXZER , Z , FACTOR , IOLOG , 

ITER1 , ITER2 , LOOK, PICK, PRINT, 

TERMIN , UNBDDQ , YQ ) 

2301  CONTINUE 

IF  ( DONEIT. EQ. 1)  GO  TO  6000 
IF  ( INTNOD . LT . MAXNDS )  GO  TO  2304 
FLG0UT=1 .0 
GO  TO  6000 

*  *  *CHECK  TO  SEE  IF  THE  CURRENT  NODE  CAN  BE 
FATHOMED  BY  BOUNDING*** 

2304  ZMOST=- 1 . 0D2 5 
CNT=0 . 0 

DO  2310  I=NUMX1 , NUMXY 

CALL  XGETUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

LOWLY ( I ) =LJ 
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UPLY  ( I )  =(J  J 
LJ=0 . 0 
UJ=UJO(I) 

CALL  XADDUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

2310  CONTINUE 

GO  TO  4000 

2320  DO  2330  I=NUMX1 , NUMXY 
LJ=LOWLY ( I ) 

UJ=UPLY ( I ) 

CALL  XADDUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI, MEMR, U J ) 

2330  CONTINUE 

IP  (TERMIN.NE. 1 )  ZTEMP=- 1 . 0D26 
ZBND ( INTNOD ) =ZTEMP 
DIFF=ZBND ( INTNOD ) -ZBEST 
IF  (DIFF.LE.  0.000001)  GO  TO  1998 
GO  TO  4000 
1999  CONTINUE 

♦♦♦DETERMINE  VALUE  OF  EACH  VARIABLE  IN 
CURRENT  SOLUTION*** 

DO  670  I=NUMX1 ,NSTRUC 

IF  {STATUS(I))  400,500,600 
400  IF  ( STATUS ( I ) . EQ . - 2  .OR.  STATUS ( I ) . EQ . -3 ) 
1  GO  TO  430 

IF  ( STATUS ( I ) . EQ . -4 )  GO  TO  500 
CALL  XGETT7R  (  BNDTYP  ,  IOERR  ,  I ,  L J  ,  MAPI  ,  MAPR  , 
MEMI , MEMR, UJ) 

BBVAR ( I ) =UJ 
GO  TO  670 

430  DO  440  J=1 , M 

IF ( BASIS ( J) .NE. I)  GO  TO  440 
BBVAR ( I ) =XBZERO { J ) 

GO  TO  670 
440  CONTINUE 

500  IF  ( BNDTYP . NE . 4 )  GO  TO  555 

CALL  XGETUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

IF  (LJ.EQ.O.O)  GO  TO  555 
BBVAR ( I ) =LJ 
GO  TO  670 

555  BBVAR ( I ) =0 . 0 

GO  TO  670 

600  IX=STATUS ( I ) 

BBVAR ( I ) =XBZERO { IX ) 
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670  CONTINUE 

C  *  * ‘FEASIBILITY  CHECK /SELECT  BRANCHING  VARIABLE*** 

C  THIS  SECTION  CHECKS  TO  SEE  IF  U*G=0  FOR  EACH 

C  CONSTRAINT  ON  Y.  IF  YES,  THEN  FEASIBLE  SOLUTION 

C  FOUND.  IF  NO,  THEN  PICK  LARGEST  VALUE 

C  OF  U*G  AND  GO  TO  BRANCH  ON  U(IE  MAKE  U  ZERO) 

C  FLAG=1  MEANS  NORMAL  WITH  NO  WORRY  ABOUT  INTEGERS; 

C  FLAG=2  MEANS  WORKING  WITH  Y  VAR  AND  LOWER  BOUND  U 

C  FLAG=3  MEANS  WORKING  WITH  Y  VAR  AND  ITS  UPPER 


C  BOUND  U . 

C 

BBTBIG=0. 00001 

VCNT=0 

FLGUP=1 

DO  1200  I=NUMX1 , NSTOPV 

IF  (VARTYP( I) -EQ. 0)  GO  TO  1210 

CALL  XGETUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

VCNT=VCNT+ 1 

IF  (UJ.GE.UJO(I) )  GO  TO  1205 

IF  { VARTYP { I ) . LT . 3  .AND.  U J . EQ . BBVAR ( I ) ) 

1  GO  TO  1200 

BBTEM2= ( UJ-BBVAR ( I ) ) * BBVAR ( BLVAR+VCNT ) 

IF  (BBTEM2 .LE.BBTBIG)  GO  TO  1205 

BBTBIG=BBTEM2 

KK=I 

DUMCNT=VCNT 

FLGUP=3 

1 205  BBTEM1= ( BBVAR ( I ) -L J ) *BBVAR ( I+CRITV ) 

IF  (BBTEM1 .LE.BBTBIG)  GO  TO  1200 

BBTBIG=BBTEM1 

KK=I 

FLGUP=2 

GO  TO  1200 

1210  BBTEMP=BBVAR ( I ) *BBVAR( I+CRITV) 

IF  {BBTEMP. LE.BBTBIG)  GO  TO  1200 
BBTBIG=BBTEMP 
KK= I 
FLGUP=1 
1200  CONTINUE 

IF  (BBTBIG. LE.O. 00001 )  GO  TO  2000 
*  *  * BRANCH  ON  SELECTED  VARIABLE*** 

BRANCHES  ON  SELECTED  U  VARIABLE (IE  SETS  U  TO  C ) 
W-ARRAY  USED  TO  TELL  WHICH  VARIABLE  OF  A  U-G  PAIR 
IS  SET.  W( I ) =K  MEANS  VARIABLE  K  SET  AT  LEVEL  I  OF 


o  o  o  o  o  o  o 


I 

TREE.  IF  K<0,  THAT  MEANS  ALTERNATIVE  OF  U-G 
PAIR  NOT  CONSIDERED  YET. 

1500  LEVEL=LEVEL+ 1 

FLAGUP ( LEVEL ) =FLGUP 

GO  TO  (1510,1510,1520)  FLAGUP ( LEVEL ) 

1510  W( LEVEL) =-KK 
L=KK+CRITV 
UJ=0 . 0 
LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

GO  TO  4000 
1520  W( LEVEL ) =-KK 

L=BLVAR+DUMCNT 
UJ=0 . 0 
LJ=0 . 0 

IVARU { LEVEL ) =DUMCNT 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

GO  TO  4000 

♦♦♦UPDATE  INCUMBENT  SOLUTION  OF  RELAXED  BLPP*** 
2000  ZMOST=ZTEMP 

IF ( ZMOST . GT . 1 . 0D5 )  GO  TO  5000 
DO  2100  K=1,M 

FIXZER ( K ) =XBZERO ( K ) 

FIXBAS ( K) =BASIS ( K) 

2100  CONTINUE 

DO  2200  K=1 , N 

FIXSTA ( K ) =STATUS ( K ) 

2200  CONTINUE 

DO  2250  K=1 , NSTRUC 

CALL  XGETUB ( BNDTYP , IOERR , K , LJ , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

BESTLB ( K ) =L J 
BESTUB ( K ) =UJ 
2250  CONTINUE 

IF  ( LEVEL. EQ.O)  GO  TO  1998 
GO  TO  3100 

2500  IF  (TERMIN.EQ. 2)  GO  TO  5000 

IF  (TERMIN.NE.l  .AND,  BBITER.EQ.O)  GO  TO  5000 
‘♦♦BACKTRACK*** 

FINDS  A  LIVE  NODE,  FREES  U  VAR,  SETS  G  VAR  TO  0 
ALSO  FREES  VARIABLES  WHICH  HAVE  HAD  BOTH 
ALTERNATIVES  CONSIDERED. 

3100  CONTINUE 


J 
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IF  { LEVEL. EQ.O)  GO  TO  1998 
IF ( W( LEVEL ) .LT.O)  GO  TO  3200 
L=W( LEVEL) 

UJ=UJO(L) 

LJ=0 . 0 

IF  ( VARTYP (L) .EQ.O  .OR.  VARTYP ( L ) . EQ . 3 )  GO  TO  3120 
IF  { INTLEV .EQ.O)  GO  TO  3120 
DO  3110  K=l, INTLEV 

IF  ( ABS ( SEPVAR( K ) ) . NE . L )  GO  TO  3110 
LJ=LOWER(K) 

UJ=UPPER{ K) 

3110  CONTINUE 

3120  CALL  XADDUB ( BNDTYP , IOERR ,  L  ,  L  J  , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

W( LEVEL )=0 
LEVEL=LEVEL-1 
GO  TO  3100 

3200  GO  TO  (3210,3220,3230)  FLAGUP ( LEVEL ) 

C  ***RESET  U  OF  A  CONTINUOUS  UNBOUNDED  VARIABLE*** 

3210  L--W ( LEVEL ) +CRITV 
UJ=UJO ( L ) 

LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

C  ***SET  A  CONT  Y  OR  G  TO  ZERO*** 

W ( LEVEL ) =-W ( LEVEL ) 

L=W( LEVEL) 

UJ=0 . 0 
LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

GO  TO  4000 

C  ***WORK  WITH  INTEGER  Y  AND  ITS  LOWER  BOUND  U*** 

3220  L=-W( LEVEL )+CRITV 
C  RESET  THE  U 

UJ=UJO ( L ) 

L J=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

C  *  *  *SET  Y  TO  ZERO  OR  A  PREVIOUS  SET  LOWER  BOUND*** 

W( LEVEL )=-W( LEVEL) 

L=W< LEVEL) 

LJ=0 . 0 
UJ=0.0 

IF  (INTLEV. EQ.O  .OR.  VARTYP ( L ). EQ . 3 )  GO  TO  3226 


ooo  oo  oooo 


DO  3225  K=1 , INTLEV 

IF  { ABS ( SEPVAR { K ) ) . NE . L )  GO  TO  3225 
LJ=LOWER(K) 

UJ=LJ 

3225  CONTINUE 

3226  CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

GO  TO  4000 

***WORK  WITH  INTEGER  Y  AND  ITS  UPPER  BOUND  U 
OR  WITH  CONTINUOUS  BOUNDED  Y  AND  ITS  UPPER 
BOUND*  *  * 

3230  L=BLVAR+IVARU{ LEVEL) 

RESET  THE  U 
UJ=UJO(L) 

LJ=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , L , L J , MAPI , MAPR , 

I  MEMI , MEMR , U J ) 

***SET  Y  TO  ITS  UPPER  BOUND  OR  TO  A  PREVIOUSLY  SET 
UPPER  BOUND*** 

W ( LEVEL )=-W( LEVEL) 

L=W( LEVEL) 

UJ=UJO(L) 

LJ=UJO(L) 

IF  (INTLEV. EQ.O  .OR.  VARTYP ( L ) . EQ . 3 )  GO  TO  3236 
DO  3235  K=l, INTLEV 

IF  ( ABS ( SEPVAR ( K) ) .NE.L)  GO  TO  3235 
UJ=UPPER(K) 

LJ=UJ 

3235  CONTINUE 

3236  CALL  XADDUB ( BNDTYP , IOERR , L , LJ , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

*  *  *USE  THE  XMP  SUBROUTINES  TO  SOLVE  A  LINEAR 
PROGRAMMING  PROBLEM  USING  THE  PRIMAL 
SIMPLEX  METHOD*** 

4000  DO  4001  K=1 , M 

BASIS (K)=0KBAS(K) 

4001  CONTINUE 

DO  4002  K=1,N 

STATUS ( K ) =0KSTAT { K ) 

4002  CONTINUE 


oo  oooo  oooo 


CALL  XSTART ( B , BASCB , BASIS , BASLB , BASUB , 

1  BNDTYP , BOUND , 

2  COLA , COLI , COLMAX , IOERR , 

3  M , MAP I , MAPR , MAXM , MAXN , MEMI , 

4  MEMR,N,NTYPE2,SCODE, STATUS, 

5  UZERO , XBZERO , Z ) 

C 

BBITER=BBITER+1 

C 

4500  CALL  XPRIML (B, BASCB, BASIS , BASLB, BASUB, BNDTYP, 

1  BOUND, COLA, COLI, COLMAX, 

2  FACTOR , IOERR , IOLOG , ITER1 , ITER2 , 

3  I TER 2 , LOOK , M , MAPI , MAPR , MAXM , MAXN , 

4  MEMI, MEMR,N,NTYPE2, PICK, PRINT, 

5  STATUS, TERMIN,UNBDDQ, UZERO, 

6  XBZERO , YQ , Z ) 

FLIP  THE  SIGN  OF  THE  OBJECTIVE  FUNCTION  VALUE  IF 
WE  ARE  MINIMIZING. 

ZTEMP=Z 

IF(MINMAX  .EQ.  -1)  ZTEMP=-ZTEMP 
CNT=CNT+1 .0 

IF  (CNT.EQ.l)  GO  TO  2320 
IF ( TERMIN . NE . 1 )  GO  TO  2500 
DO  4010  K=1 , M 

OKBAS ( K ) =B AS I S ( K ) 

4010  CONTINUE 

DO  4020  K=1 , N 

OKSTAT { K ) =STATUS ( K ) 

4020  CONTINUE 

IF  { BBITER . EQ . 0 )  GO  TO  2301 
IF  ( ZTEMP . LE . ZMOST )  GO  TO  3100 
GO  TO  1999 

THE  MIXED  INTEGER  BLPP  HAS  NO  FEASIBLE  SOLUTION 
OR  HAS  AN  UNBOUNDED  SOLUTION. 

5000  WRITE( IOLOG, 7000) 

7000  FORMAT { 1H1///,10X, ' THE  PROBLEM  WENT  BOOM  ' , 

1  'WITH  A  CRASH. ’ ) 

GO  TO  314 

** “PRINT  OUT  THE  SOLUTION*** 


I 


6000  CALL  CPTIME ( T0TCP2 , VIRCP2 ) 

IP  (FLGOUT.EQ. 1 .0)  WRITE  (6,1984) 

1984  FORMAT ('  THE  FOLLOWING  SOLUTION  IS  NOT  OPTIMAL.' , 

1  '  MAX  NODES  EXCEEDED ' ) 

CALL  XPRINT ( BESTB , BNDTYP , BOUND , 

1  IOERR , IOLOG , NUMXY , M , 

2  MAPI , MAPR , MAXM , MAXN , MEMI , MEMR , 

3  N , NTYPE2 , BESTAT , XBEST , ZBEST , 

4  BESTLO , BESTUP ) 

i 

IF  (FLGOUT.EQ. 1 .0)  WRITE  (6,1985) 

1985  FORMAT ('  THE  ABOVE  SOLUTION  IS  NOT  OPTIMAL.', 

1  '  MAX  NODES  EXCEEDED ' ) 

WRITE( IOLOG, 1986) BBITER 

1986  FORMAT ( 5X ,' THE  NUMBER  OF  B&B  ITERATIONS  IS', 17) 
WRITE  (6,1987)  INTNOD 

1987  FORMAT ( '  THE  NUMBER  OF  INTEGER  NODES  IS', 16) 
IBSTCP=BSTCP-T0TCP1 

WRITE  (6,947)  BSTNOD , IBSTCP 
947  FORMAT ('  BEST  SOLUTION  AT  NODE  ',15, 

1  '  AT  TIME  1 ,18) 

t 

» 

314  CONTINUE 

» 

TOTCP=TOTCP2-TOTCP1 
VIRCP=VIRCP2 -VIRCP 1 
WRITE  (6,70)  TOTCP , VIRCP 
70  FORMAT (3X,'  TOTAL  CPTIME  =',I9,3X, 

1  'VIRTUAL  CPTIME  =',I9) 

STOP 

END 

SUBROUTINE  FIXINT ( ZMOST , ZBEST , NUMX , NUMY , VARTYP , 

1  U JO, YCJ, LOWER, UPPER, XBEST, 

2  BESTB, BESTAT,  BESTLO , BESTUP , 

3  SEPVAR , DONEIT , PAIR , BLVAR , 

4  NUMXY, NUMX1,CJ1, INTNOD, RANK, 

5  NUMINT , BESTUB , BESTLB , CONX , CONY , 

6  NSTRUC, INTLEV,BSTCP, BSTNOD, B, 

7  BASCB , FIXBAS , BASLB , BASUB , BLOW , 

8  ROWTYP, BNDTYP, BOUND, COLA, COLI, 

9  COLMAX, IOERR, M, MAPI , MAPR, MAXM, 

0  MAXN, MEMI, MEMR, N , NTYPE2 , SCODE , 

1  FIXSTA , UZERO , FIXZER , Z , FACTOR , 

2  IOLOG, ITER1,ITER2, LOOK, PICK, 

3  PRINT, TERMIN,UNBDDQ,YQ) 
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c  *  *  *  *  *PURPOSE 

C  THIS  SUBROUTINE  PERFORMS  THE  BRANCH  AND  BOUND 

C  PROCESS  ON  THE  INTEGER  VARIABLES  OF  THE  MIXED 

C  INTEGER  BLPP .  ALTERNATIVE  CONSTRAINTS  ARE  IMPOSED 

C  BY  PLACING  UPPER  AND  LOWER  BOUNDS  ON  THE 

C  VARIABLES . 

C 

C  *  *  *  *  ^DECLARE  XMP  VARIABLES 

INTEGER  COLMAX , MAXM , MAXN , P I CK 

DOUBLE  PRECISION  XBZERO ( MAXM) , LJ , UJ , MEMR( LENR) , 

1  B(MAXM) ,BASCB( MAXM) ,BASLB( MAXM) , 

BASUB ( MAXM ) # BOUND , COLA ( COLMAX) , 
UZERO (MAXM) ,Z,BLOW( 1) , YQ(MAXM) 
INTEGER  FACTOR . IOLOG , ITER1 , ITER2 , LOOK , PRINT , 


TERMIN,UNBDDQ,BASIS(MAXM) ,M,N, 

STATUS (MAXN) ,  MAPI (LENMI) , MAPR ( LENMR ) , 
MEMI ( LENI ) , BNDTYP , IOERR , NSTRUC , NTYPE2 , 
SCODE , COLI ( COLMAX ) , ROWTYP ( MAXM ) 
****DECLARE  BLPP  VARIABLES 

DOUBLE  PRECISION  LOWER ( 999 ), UPPER ( 999 ), ZMOST , 

XBEST ( 100) , UJO ( 600 ) , YCJ(600) , 
BESTLO ( 600 ) , BESTUP ( 600 ) , CHEC , 

C J1 ( 600 ) , DIFFR , UP , LO , ZBEST , 
BESTUB ( 600 ) , BESTLB ( 600 ) 

INTEGER  BIFEAS , NUMXY , VARTYP ( 600 ) , WORK (100) ,CONX, 
CONY , INTLEV , BESTB (100), NUMX1 , IB , IBAS , 
BESTAT ( MAXN ) , SEPVAR ( 999 ) , BSTCP , BSTNOD , 
DONEIT , IXBAS , VXPLOR ( 999 ) , RANK (100) , 

PAIR{ 100) , NUMX , BLVAR , NUMY 
*****COMMON  VARIABLES 
COMMON/XMPCOM/BIG , SMALL , ZL , ZLC , EPS1 , 

1  EPS2 , EPS3 , EPS4 , EPS5 , EPS6 

DOUBLE  PRECISION  BIG , SMALL , ZL , ZLC , 

1  EPS1 , EPS2 , EPS3 , EPS4 , EPS5 , EPS6 

COMMON/XMPLEN/LENI , LENMI , LENMR , LENR 
INTEGER  LENI, LENMI, LENMR, LENR 


IF  ( ZMOST. LE. -1 .0D20)  GO  TO  2000 


C* 

C* 

C* 

C* 

C* 


ABOVE  LINE  USED  IN  ALGORITHMS  1,  2,  3,  AND  4 
FOR  ALGORITHMS  5,  6,  7,  AND  8  SUBSTITUTE 
FOLLOWING  LINES: 

DIFF=ZMOST -ZBEST 

IF  (DIFF.LE. 0.000001)  GO  TO  2000 


3 


a 


i  M'l 


C  ***SELECT  A  BRANCHING  VARIABLE*** 

CHEC=-100000 . 

IB=0 

DO  100  1=1, NUMXY 

IF  ( VARTYP ( I ) . EQ . 0  .OR.  VARTYP ( I ) . EQ . 3 ) 

1  GO  TO  100 

IF  ( STATUS ( I ) . LE . 0 )  GO  TO  100 
J J=STATUS ( I ) 

IBAS=DINT ( XBZERO ( JJ ) ) 

DIFFR=XBZERO ( J J ) -DFLOAT ( IBAS ) 

IF  (DIFFR.LE. 0.000001  .OR.  DIFFR . GT . 0 . 999999 ) 
1  GO  TO  100 

IF  ( DIFFR. LT.CHEC)  GO  TO  100 
IB=I 

IXBAS-IBAS 

CHEC=DIFFR 

100  CONTINUE 

IF  (IB.EQ.O)  GO  TO  110 
C  ***BRANCH  ON  SELECTED  VARIABLE*** 

101  CALL  XGETUB { BNDTYP , IOERR , IB , L J , MAPI , MAPR , 

1  MEMI , MEMR , U J ) 

IF  (CJl(IB) .GT.O.O)  GO  TO  105 

102  UJ=DFLOAT ( IXBAS ) 

INTLEV=INTLEV+1 
SEPVAR ( INTLEV ) =IB 

IF  (IB.LE.NUMX)  GO  TO  107 
L0=0 . 0 

UP=UJO ( PAIR ( IB ) ) 

CALL  XADDUB ( BNDTYP , IOERR , PAIR ( IB ) , LO , MAPI , MAPR , 

1  MEMI , MEMR , UP ) 

GO  TO  107 

105  LJ=DFLOAT { IXBAS ) +1 .0 
INTLEV=INTLEV+1 
SEPVAR( INTLEV) =-IB 

107  CALL  XADDUB ( BNDTYP, I OERR, I B,LJ, MAP I, MAPR, 

1  MEMI, MEMR, UJ) 

INTN0D=INTN0D+1 
VXPLOR( INTLEV) =0 
LOWER ( INTLEV )=LJ 
UPPER { INTLEV )=UJ 
GO  TO  3999 


c 


***CHECK  TO  SEE  IF  AT  A  BIFEASIBLE  POINT*** 

110  CALL  BILEVF  ( NUMX , NUMY , VARTYP , BIFEAS , UJO , YCJ , 

1  BESTUB , BESTLB , CONX , CONY , NSTRUC , C J1 , 

2  BSTCP , BSTNOD , XBEST , BESTB , BESTAT , 

3  BESTLO , BESTUP , ZBEST , INTNOD , B , BASCB , 

4  BASIS , BASLB , BASUB , BLOW , ROWTYP , 

5  BNDTYP , BOUND , COLA , COLI , COLMAX , IOERR , 

6  M ,  MAP  I ,  MAPR  ,  MAXM ,  MAXN ,  MEMI ,  MEMR , 

7  N , NTYPE2 , SCODE , STATUS , UZERO , XBZERO , 

8  Z , FACTOR , IOLOG , ITER1 , ITER2 , LOOK , 

9  PICK, PRINT, TERMIN,UNBDDQ,YQ) 

GO  TO  3500 

Q* **************************************************** 


c* 

ABOVE  LINE  USED 

IN  ALGORITHMS  1  AND  5 

* 

c* 

FOR  ALGORITHMS  2 

AND 

6 

SUBSTITUTE 

* 

c* 

FOLLOWING  LINE: 

* 

c* 

IF  ( BIFEAS. NE. 2) 

GO 

TO 

3500 

* 

c* 

FOR  ALGORITHMS  3 

AND 

7 

SUBSTITUTE 

* 

c* 

FOLLOWING  LINE: 

* 

c* 

IF  ( BIFEAS. EQ. 1) 

GO 

TO 

3500 

* 

c* 

FOR  ALGORITHMS  4 

AND 

8 

SUBSTITUTE 

* 

c* 

FOLLOWING  LINE: 

* 

c* 

CONTINUE 

* 

C  *  *  * BACKTRACK*  *  * 

2000  IF  ( INTLEV . EQ . 0 )  GO  TO  4000 

IF  (VXPLOR( INTLEV) .EQ.O)  GO  TO  3000 
LL=ABS { SEPVAR ( INTLEV ) ) 

LJ=0 . 0 
UJ=UJO(LL) 

IF  ( INTLEV. EQ. 1)  GO  TO  2505 
KSTOP=INTLEV- 1 
DO  2500  K=1 , KSTOP 

IF  (ABS( SEPVAR (K) ) .NE.LL)  GO  TO  2500 
LJ=LOWER(K) 

UJ=UPPER(K) 

2500  CONTINUE 

2505  IF  (UJ.LT.UJO(LL)  .OR.  LL.LT.NUMX1)  GO  TO  2510 
UP=0.0 
L0=0 . 0 

CALL  XADDUB ( BNDTYP , IOERR , PAIR ( LL ) , LO , MAPI , MAPR , 
1  MEMI , MEMR , UP ) 

2510  CALL  XADDUB ( BNDTYP , IOERR , LL , L J , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

SEPVAR ( INTLEV) =0 


i 


3 


o  o 


'«y 
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VXPLOR( INTLEV) =0 
INTLEV= INTLEV- 1 
GO  TO  2000 

3000  MM=ABS ( SEPVAR ( INTLEV ) } 

INTN0D=INTN0D+1 

VXPL0R< INTLEV )=1 

KST0P=INTLEV-1 

IF  (MM.LT.NUMX1 )  GO  TO  3200 

IF  (SEPVAR( INTLEV) .GT.O)  GO  TO  3300 

L0=0 . 0 

UP=UJ0 ( PAIR( MM) ) 

CALL  XADDUB ( BNDTYP , 10 ERR , PAIR ( MM ) , LO , MAPI , MAPR , 
1  MEMI ( MEMR , UP ) 

3200  IF  ( SEPVAR ( INTLEV) .GT.O)  GO  TO  3300 
SEPVAR ( INTLEV ) =MM 
LJ=0 . 0 

IF  ( INTLEV. EQ.l)  GO  TO  3255 
DO  3250  K=1 , KSTOP 

IF  ( ABS ( SEPVAR ( K ) ) . NE . MM )  GO  TO  3250 
LJ=LOWER(K) 

3250  CONTINUE 
3255  UJ=LOWER( INTLEV) -1.0 
IF  (UJ.LT.0.0)  UJ=0.0 
GO  TO  3400 

3300  L J =UPPER ( INTLEV ) + 1 . 

UJ=UJO(MM) 

SEPVAR ( INTLEV) =-MM 

IF  ( INTLEV . EQ . 1 )  GO  TO  3355 

DO  3350  K=l, KSTOP 

IF ( ABS { SEPVAR (K) ) .NE.MM)  GO  TO  3350 
UJ=UPPER( K) 

3350  CONTINUE 

3355  IF ( UJ . LT . UJO (MM)  .OR.  MM.LT.NUMX1 )  GO  TO  3400 
L0=0 . 0 
UP=0 . 0 

CALL  XADDUB ( BNDTYP, I OERR, PAIR (MM) , LO , MAPI , MAPR , 
1  MEMI , MEMR , UP ) 

3400  CALL  XADDUB ( BNDTYP , I OERR , MM , LJ , MAPI , MAPR , 

1  MEMI , MEMR, UJ) 

LOWER ( INTLEV )=LJ 
UPPER { INTLEV) =UJ 
GO  TO  3999 

"'SELECT  A  BRANCHING  VARIABLE  WHEN  INTEGER 
REQUIREMENTS  SATISFIED*** 

3500  K= 1 


o  o  o 


J=NUMINT 
3510  IB=RANK( K) 

IF  (IB.EQ.O)  GO  TO  2000 

CALL  XGETUB ( BNDTYP , IOERR , IB , L J , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

IF  (LJ.NE.UJ)  GO  TO  3520 
WORK { J ) =RANK ( K ) 

J=J-1 

K-K+l 

GO  TO  3510 

3520  IF  (UJ.EQ.UBO(IB)  .OR.  CJ1 ( IB ) . LT . 0 . 0 )  GO  TO  3525 
IXBAS=UJ-1 
GO  TO  3527 
3525  IXBAS=LJ 
3527  WORK ( J ) =RANK ( K ) 

L=1 

3530  IF  (L.EQ.J)  GO  TO  3540 
WORK ( L ) =RANK ( K+ 1 ) 

L=L+1 

K=K+1 

GO  TO  3530 

3540  DO  3550  I=1,NUMINT 
RANK ( I ) =WORK ( I ) 

3550  CONTINUE 

IF  (UJ.EW.UBO(IB)  .OR.  C J1 ( IB ) . GE . 0 . 0 )  GO  TO  102 
GO  TO  105 

3999  RETURN 

4000  D0NEIT=1 
RETURN 


END 

SUBROUTINE  BILEVF  ( NUMX , NUMY , VARTYP , BIFEAS , UJO , 

1  YCJ , BESTUB , BESTLB , CONX , CONY , 

2  NSTRUC , C J1 , BSTCP , BSTNOD , XBEST , 

3  BESTB , BESTAT , BESTLO , BESTUP , 

4  ZBEST , INTNOD , B , BASCB , BASIS , 

5  BASLB , BASUB , BLOW , ROWTYP , BNDTYP , 

6  BOUND, COLA, COLI ,COLMAX, IOERR, M, 

7  MAPI , MAPR, MAXM,MAXN, MEMI , MEMR, 

8  N,NTYPE2,SC0DE, STATUS, UZERO, 

9  XBZERO , Z , FACTOR , IOLOG , ITER1 , 

0  ITER2, LOOK, PICK, PRINT, TERMIN, 

1  UNBDDQ , YQ ) 

**** ^PURPOSE 

THIS  SUBROUTINE  IS  USED  TO  FIX  THE  VARIABLES 
CONTROLLED  BY  THE  LEADER  AND  SOLVE  THE  RESULTING 


c 

c 

c 

c 


c 


c 


c 

c 
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MIXED  INTEGER  PROBLEM  TO  DETERMINE  THE  FOLLOWER'S 
RESPONSE. 


1 

2 

3 

1 

2 

3 

4 


1 

2 

3 

1 

2 

1 

2 

3 

3 

4 

1 

2 


1 

I 


*  *  *  *  * DECLARE  XMP  VARIABLES 
INTEGER  COLMAX , MAXM , MAXN , PICK 

DOUBLE  PRECISION  XBZERO ( MAXM) , MEMR( LENR) , B ( MAXM) , 

BASCB(MAXM) , BASLB ( MAXM ) , 

BASUB ( 600 ) , BOUND , COLA ( COLMAX ) , 
UZERO(MAXM) , YQ ( MAXM ) ,Z,BL0W( 1) 
INTEGER  FACTOR , IOLOG , ITER1 , ITER2 , LOOK , PRINT , 
UNBDDQ,M,N, STATUS (MAXN) ,MAPI{LENI) , 

MAPR ( LENMR ) , MEMI ( LENI ) , BNDTYP , IOERR „ 

NSTRUC , NTYPE2 .BASIS (MAXM) , ROWTYP ( MAXM ) , 
TERMIN 

*  *  *  *  * DECLARE  BLPP  VARIABLES 

DOUBLE  PRECISION  XBZERO ( MAXM) ,UJO( 600) , 

BESTUB { 600 ) , BESTLB ( 600 ) , 

CJ1(600) , XBEST ( 100 ) ,BESTL0(600) , 
BESTUP ( 600 ) ,  ZBEST , ZMOST , YC J ( 600 ) 
INTEGER  BIFEAS , VARTYP ( 600 ) , BESTB (100), 

BESTAT ( MAXN ) , NUMX , NUMY , CONX , CONY , 

SCODE , COLI ( COLMAX ) , INTNOD , BSTNOD , BSTCP , 
DOUBLE  PRECISION  CJ , BILO ( 600 ) , BIUP ( 600 ) , 

BIBLO ( 600 ) , BIBUP ( 600 ) , 

UPPR ( 600 ) , LOWR ( 600 ) , VARVAL , L J , 

U J , DIFFR , YREM ( 100) ,BIZBST, 

DUMXBZ( 100) , CHEC , DUMBUB (100) , 
DUMBLB( 100) , BIBEST ( 100) 

INTEGER  BILEV, BIPL0R(500) ,BISEP(500) ,BIBSTB( 100) , 
BISTAT ( 600 ) , YCNTR , DUMSTA ( 600 ) ,DUMBAS( 100) , 
IBAS , IB , COLLEN 
♦♦♦♦♦COMMON  VARIABLES 
COMMON/XMPCOM/BIG , SMALL , ZL , ZLC , EPS1 , 

EPS2 , EPS3 , EPS4 , EPS5 , EPS6 
DOUBLE  PRECISION  BIG , SMALL , ZL , ZLC , EPS1 , EPS2 , 

EPS3 , EPS4 , EPS5 , EPS6 
COMMON/XMPLEN/LENI , LENMI , LENMR , LENR 
INTEGER  LENI , LENMI , LENMR , LENR 


♦♦♦INITIALIZE  VARIABLES*** 

BIZBST=-1 . 0D25 

Z=0 . 0 

BILEV=0 

ZM0ST=0 . 0 

BIFEAS=0 


mm 
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NUMXY =NUMX+NUMY 
NUMX 1  =NUMX + 1 
NUMXY 1 =NUMXY + 1 
NSTOPV=NUMXY+CONY 

C  *  *  * SAVE  BOUNDS  OF  VARIABLES* ** 

DO  1100  1=1 , NSTRUC 

CALL  XGETUB ( BNDTYP , I0ERR , I , LJ , MAPI , MAPR , 
1  MEMI , MEMR , UJ ) 

UPPR( I ) =UJ 
LOWR ( I ) =LJ 

IF  ( I.LE.NSTOPV)  GO  TO  1100 
BIBLO ( I ) =LJ 
BIBUP ( I ) =UJ 
1100  CONTINUE 

C  ***FREE  ALL  G'S  AND  U'S*** 

DO  1200  I =NUMXY1 , NSTRUC 
UJ=UJ0{I) 

LJ=0 . 0 


CALL  XADDUB ( BNDTYP , IOERR , I , L J , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

1200  CONTINUE 

C  *  *  *  SAVE  B AS IS, STATUS, XBZERO*** 

DO  1225  J=1,M 

DUMXBZ ( J ) = XBZERO ( J ) 

DUMBAS ( J ) =BASIS ( J ) 

DUMBUB ( J ) =BASUB ( J ) 

DUMBLB ( J ) =BASLB ( J ) 

1225  CONTINUE 

DO  1275  J=1,N 

DUMSTA ( J ) =STATUS ( J ) 

1275  CONTINUE 

C  ***CHANGE  OBJECTIVE  FUNCTION  COEFFICIENTS*** 

DO  1400  1=1, NUMXY 
C J=YC J ( I ) 

CALL  XCHGCJ ( MAPI , MAPR , MEMI , MEMR , C J , I , MAXN) 
1400  CONTINUE 

C  ***RESET  THE  BASCB  ARRAY*** 

DO  1450  1=1, M 
J=BASIS{ I) 

CALL  XGETAJ ( CJ , COLA , COLI , COLLEN , COLMAX , IOERR , 
1  J , MAP I , MAPR, MEMI , MEMR) 

BASCB ( I ) =C J 
1450  CONTINUE 

C  ***RESET  ALL  BOUNDS  ON  Y*** 

DO  1500  I =NUMX1 , NUMXY 


j.l'i.l*'!  #•«.#<*  *'*  k'4  I 


i  kU.i  i 


1500 


5000 


5200 


5210 


5220 

5300 


5310 


5400 


5490 


LJ=0 . 0 
UJ=UJ0(I) 

CALL  XADDUB ( BNDTYP , I0ERR ,  I ,  L  J  , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

CONTINUE 

***FIX  THE  X'S  AND  REMEMBER  THE  Y'S*** 
YCNTR=1 

DO  5100  1=1, NUMXY 

IF  ( DUMSTA ( I ) )  5200,5300,5400 
IF  ( DUMSTA ( I ) . EQ . - 2  .OR.  DUMSTA ( I ) . EQ . - 3 ) 
1  GO  TO  5210 

IF  ( DUMSTA ( I ) . EQ . -4 )  GO  TO  5300 
VARVAL=BESTUB ( I ) 

GO  TO  5490 
DO  5220  J=1,M 

IF  ( DUMBAS ( J ) . NE . I )  GO  TO  5220 
VARVAL=DUMXBZ ( J } 

GO  TO  5490 
CONTINUE 

IF  ( BNDTYP . NE . 4 )  GO  TO  5310 
VARVAL=BESTLB { I ) 

GO  TO  5490 
VARVAL=0 . 0 
GO  TO  5490 
IXX=DUMSTA{ I) 

VARVAL=DUMXBZ ( IXX) 

CONTINUE 

IF  (I.GT.NUMX)  GO  TO  5495 
ZM0ST=ZM0ST+C J1 ( I ) * VARVAL 
CALL  XADDUB ( BNDTYP , IOERR , I , VARVAL , 

1  MAP I, MAPR, MEMI, MEMR, U JO( I) ) 

GO  TO  5100 


5495 


5100 


6000 


YREM ( YCNTR ) =VARVAL 
YCNTR=YCNTR+ 1 
CONTINUE 
GO  TO  6900 

*  *  *SELECT  A  BRANCHING  VARIABLE*** 

CHEC=-100000. 

IB=0 

DO  6100  I=NUMX1 , NUMXY 

IF  ( VARTYP { I ) . EQ . 0  .OR.  VARTYP { I ) . EQ . 3 )  GO  TO  6100 
IF  ( STATUS ( I ) . LE . 0 )  GO  TO  6100 
JJ=STATUS ( I ) 

IBAS=DINT ( XBZERO ( J J ) ) 

DIFFR=XBZERO ( JJ ) -DFLOAT ( IBAS ) 


IF  (DIFFR.LE. 0.000001  .OR.  DIFFR . GT . 0 . 999999 ) 
1  GO  TO  6100 
IF  ( DIFFR. LT.CHEC)  GO  TO  6100 
IB=I 

IXBAS=IBAS 
CHEC=DIFFR 
6100  CONTINUE 

IF  (IB.EQ.O)  GO  TO  110 
C  *  *  * BRANCH  ON  SELECTED  VARIABLE*** 

101  BILEV=BILEV+1 

CALL  XGETUB ( BNDTYP , IOERR , IB , LJ , MAPI , MAPR , 

1  MEMI , MEMR , UJ ) 

LJ=DFLOAT ( IXBAS )  + 1 . 0 

CALL  XADDUB ( BNDTYP , IOERR , IB , LJ , MAPI , MAPR , 

1  MEMI ,MEMR,UJ) 

BIPLOR( BILEV) =0 
BISEP ( BILEV) =-IB 
BILO( BILEV )=LJ 
BIUP( BILEV) =UJ 
GO  TO  6900 
110  CONTINUE 

IF  (Z.LE.BI2BST)  GO  TO  6300 
C  FEASIBLE  SOLUTION  FOUND 

DO  6200  J=1,M 

BIBEST ( J ) =XBZERO ( J ) 

BIBSTB ( J ) =BASIS ( J ) 

6200  CONTINUE 

DO  6210  J=1(N 

BISTAT ( J ) =STATUS ( J ) 

IF  ( J.GT.NSTOPV)  GO  TO  6210 

CALL  XGETUB  (  BNDTYP  ,  I01£RR ,  J  ,  L  J ,  MAP  I ,  MAPR , 

1  MEMI , MEMR, UJ) 

BIBLO { J ) =LJ 
BIBUP ( J ) =UJ 
6210  CONTINUE 
BIZBST=Z 

IF  ( BILEV. EQ.O)  GO  TO  7000 
C  *  *  * BACKTRACK*  *  * 

6300  IF  (BILEV. EQ.O)  GO  TO  7000 

IF  (BIPLOR(BILEV) .EQ.O)  GO  TO  6500 
LL=ABS( BISEP (BILEV) ) 

LJ=0 .0 
UJ=UJO(LL) 

IF  (BILEV. EQ.l)  GO  TO  6405 
KST0P=BILEV-1 


o  o  o  o  u 


DO  6400  K=1 , KSTOP 

IF  ( ABS  ( BISEP  ( K.  •  )  .  NE  .  LL)  GO  TO  6400  I 

LJ=BILO ( K) 

UJ=BIUP ( K)  ; 

6400  CONTINUE  ) 

6405  CALL  XADDUB ( BNDTYP , IOERR , LL , LJ , MAPI , MAPR ,  5 

1  MEMI , MEMR ,  UJ )  \ 

BISEP ( BILEV) =0  . 

BIPLOR( BILEV ) =0 

BILEV=BILEV-1  , 

GO  TO  6300  j 

6500  MM=ABS( BISEP {BILEV ) )  t 

BISEP ( BILEV) =MM  J 

LJ=0 . 0 

IF  (BILEV.EQ.l)  GO  TO  6555  , 

KST0P=BILEV-1  \ 

DO  6550  K=l, KSTOP  I 

IF  { ABS { BISEP ( K ) ) . NE . ABS (BISEP ( BILEV ) ) )  ' 

1  GO  TO  6550 

LJ=BILO(K)  ! 

6550  CONTINUE 

6555  UJ=BILO ( BILEV) -1 .0  - 

CALL  XADDUB { BNDTYP , I OERR , MM , L J , MAP I , MAPR ,  ! 

1  MEMI, MEMR, UJ)  j 

BILO( BILEV) =LJ  \ 

BIUP (BILEV) =UJ  - 

BIPLOR ( BILEV) =1 

*  *  *USE  THE  XMP  SUBROUTINES  TO  SOLVE  A  LINEAR  i 

PROGRAMMING  PROBLEM  USING  THE  PRIMAL  ; 

SIMPLEX  METHOD*  *  *  ' 

6900  CALL  XSTART ( B , BASCB , BASIS , BASLB , BASUB ,  ! 

1  BNDTYP , BOUND , 

2  COLA, COLI ,COLMAX, IOERR, 

3  M, MAP I , MAPR, MAXM , MAXN , MEMI , MEMR, 

4  N,NTYPE2 , SCODE, STATUS, 

5  UZERO , XBZERO , Z )  i 


CALL  XPRIML(B, BASCB, BASIS, BASLB, 

1  BASUB , BNDTYP , BOUND , 

1  COLA, COLI .COLMAX, 

2  FACTOR , IOERR , IOLOG , ITER1 , ITER2 , 

3  LOOK , M , MAPI , MAPR , MAXM , MAXN , MEMI , MEMR , 

4  N , NTYPE2 , PICK , PRINT , STATUS , TERMIN , 

5  UNBDDQ , UZERO , XBZERO , YQ , Z ) 

IF  (TERMIN. NE. 1 )  GO  TO  6300 

i 

I 

i 


GO  TO  6000 

C  ** ‘CHECK  IF  A  BILEVEL  FEASIBLE  SOLUTION  FOUND*** 

7000  YCNTR=1 

DO  7100  I=NUMX1 , NUMXY 

IF  { BIST AT ( I ) )  7200,7300,7400 
7200  IF  ( BISTAT { I ) . EQ . - 2  .OR.  BISTAT ( I ) . EQ . -3 ) 

1  GO  TO  7230 

IF  ( BISTAT ( I ) . EQ . -4 )  GO  TO  7300 

C  HERE  FOR  NON-BASIC  VARIABLES  AT  THEIR  UPPER  BOUNDS 

VARVAL=BIBUP ( I ) 

GO  TO  7500 

7230  DO  7240  J=1,M 

IF  ( BIBSTB ( J ) . NE . I )  GO  TO  7240 
VARVAL=BIBEST( J) 

GO  TO  7500 
7240  CONTINUE 

7300  IF  ( BNDTYP . NE . 4 )  GO  TO  7310 
VARVAL=BIBLO( I) 

GO  TO  7500 
7310  VARVAL=0 . 0 

GO  TO  7500 

7400  IXX=BISTAT ( I ) 

VARVAL=BIBEST ( IXX ) 

7500  D I FFR= VARVAL - YREM ( YCNTR ) 

IF  (I.GT.NUMX)  ZMOST=ZMOST+VARVAL*CJ 1(1) 

IF  ( DABS ( DIFFR ) .LT.O .000001 )  GO  TO  7505 
BIFEAS=1 

7505  YCNTR=YCNTR+ 1 

7100  CONTINUE 

GO  TO  9000 
BIFEAS=1 

C  ** ‘RESET  BOUNDS*** 

9000  DO  9100  1=1 , NSTRUC 
UJ=UPPR ( I ) 

LJ=LOWR( I) 

CALL  XADDUB ( BNDTYP , I OERR , I , L J , MAP I , MAPR , 

1  MEMI , MEMR , UJ ) 

9100  CONTINUE 

C  *  * ‘RESET  STATUS  BASIS  XBZERO*** 

DO  9125  J=1,M 

BASIS ( J ) =DUMBAS ( J ) 

XBZERO ( J ) =DUMXBZ ( J } 

BASUB ( J ) =DUMBUB { J ) 

BASLB ( J ) =DUMBLB ( J ) 

9125  CONTINUE 


iVXVWWS 
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9175 


9200 


9250 


£«*** 

C* 

c* 

c* 

c* 

c* 

C**** 


DO  9175  J=1,N 

STATUS ( J ) =DUMSTA ( J ) 

CONTINUE 

***RESET  OBJECTIVE  FUNCTION  COEFFICIENTS*  *  * 

DO  9200  1=1, NUMX Y 
CJ=CJ1(I) 

CALL  XCFGCJ ( MAPI , MAPR , MEMI , MEMR , C J , I , MAXN ) 
CONTINUE 

** PRESET  THE  BASCB  ARRAY*** 

DO  9250  1=1, M 
J=BASIS ( I ) 

CALL  XGETAJ ( C J , COLA , COLI , COLLEN , COLMAX , IOERR , J , 
1  MAPI , MAPR, MEMI , MEMR) 

BASCB ( I ) =CJ 
CONTINUE 

*  *  *UPDATE  INCUMBENT  SOLUTION*** 

DIFFR=ZMOST-ZBEST 

IF  (DIFFR.LE. 0.000001)  GO  TO  9999 
************************************************* 

ABOVE  LINE  USED  IN  ALGORITHMS  1,  3,  4,  5,  7,  * 

AND  8  * 

FOR  ALGORITHMS  2  AND  6  SUBSTITUTE  * 

FOLLOWING  LINE:  * 

IF  (DIFFR.LE. 0.000001)  GO  TO  998  * 


************************************************* 


C**** 

c* 

c* 

c* 

C*998 

C***» 

9999 


DO  250  J=1,M 

XBEST ( J ) =BIBEST ( J ) 
BESTB ( J ) =BIBSTB ( J ) 
CONTINUE 
DO  260  J=1 f N 

BESTAT { J ) =B ISTAT ( J ) 
BESTLO ( J ) =BIBL0 ( J ) 
BESTUP ( J ) =BIBUP ( J ) 
CONTINUE 
BSTN0D=INTN0D 
ZBEST=ZMOST 

CALL  CPTIME ( BSTCP , ITIME ) 


FOR  ALGORITHMS  2  AND  6  ADD 
FOLLOWING  LINES  HERE: 

GO  TO  9999 
BIFEAS=2 


RETURN 

END 


I 


CM  CO  •«!> 


SUBROUTINE  XCHGC J ( MAPI , MAPR , MEMI , MEMR , C J , I , MAXN) 
*****PURPOSE 

CHANGES  THE  VALUE  OF  THE  OBJECTIVE  FUNCTION 
COEFFICIENTS. 

DOUBLE  PRECISION  CJ , MEMR( LENR) 

INTEGER  MAPI ( LENMI ) , MAPR( LENMR) , MEMI ( LENI ) ,MR3, 

1  MAXN 

*  * * * * *****  *  * ’COMMON  VARIABLES 
COMMON /XMPLEN /LENI , LENMI , LENMR , LENR 
INTEGER  LENI, LENMI, LENMR, LENR 
MR3=MAPR ( 3 ) 

CALL  XDATA5 ( C J , I , MEMR ( MR 3 ) , MAXN ) 

RETURN 

END 

SUBROUTINE  XDATA5 ( CJ , J , PROFIT , MAXN) 

*****  PURPOSE 

CHANGES  THE  OBJECTIVE  FUNCTION  COEFFICIENTS  IN  THE 
XMP  DATA  STRUCTURE. 


INTEGER  MAXN 

DOUBLE  PRECISION  CJ , PROFIT ( MAXN) 

PROFIT ( J)=CJ 

RETURN 

END 

SUBROUTINE  XPRINT ( BASIS , BNDTYP , BOUND , 

1  IOERR , IOLOG , NUMXY , M , 

MAP I , MAPR , MAXM , MAXN , MEMI , MEMR , 

N , NTYPE2 , STATUS , XBZERO , Z , 

BESTLO , BESTUP ) 

*  *  *  *  ^PURPOSE 

PRINTS  OUT  THE  SOLUTION  OF  THE  MIXED  INTEGER  BLPP . 


*  *  *  *  ^parameters 

INTEGER  MAXM, MAXN 

DOUBLE  PRECISION  BOUND , MEMR (LENR) , XBZERO (MAXM) , Z 
INTEGER  BNDTYP , IOERR , IOLOG , M , N , NTYPE2 
INTEGER  MAPI ( LENMI ), MAPR (LENMR) 

INTEGER  BASIS ( MAXM ) , MEMI ( LENI ) , STATUS ( MAXN ) 

*****LOcaL  VARIABLES 

DOUBLE  PRECISION  LJ , UJ , VALUE , BESTLO ( 600 ) , 

1  BESTUP (600) 

INTEGER  IX, J 

*  *  *  *  * COMMON  VARIABLES 

COMMON/ XMPLEN/ LENI , LENMI , LENMR , LENR 


a 


o  O  OOO  OOOOO  o  oo 


INTEGER  LENI , LENMI , LENMR , LENR 

*****BODY  OF  PROGRAM  (XPRINT) 

WRITE ( IOLOG , 901 ) 

901  FORMAT { 1H0 , 28H  XPRINT ...  CURRENT  SOLUTION) 

WRITE ( IOLOG , 902 ) M , N 

902  FORMAT ( 1H0, 16, 20H  LINEAR  CONSTRAINTS ,, 5X , 16 , 

1  10H  VARIABLES) 

WRITE (IOLOG, 903) 

903  FORMAT ( 1H0 , 25H  AN  SB  FOLLOWING  STATUS  , 

1  32HINDICATES  A  SUPER-BASIC  VARIABLE) 

WRITE ( IOLOG, 904) 

904  FORMAT ( 1H0 , 10H  VARIABLE , 5X , 1 OH  STATUS, 5X, 

1  15H  VALUE) 


PRINT  OUT  THE  VALUES  OF  ALL  OF  THE  BASIC  VARIABLES 
AND  ALL  OF  THE  NON-BASIC  VARIABLES  THAT  ARE  AT 
NON-ZERO  BOUNDS. 

DO  280  J=1 ,NUMXY 

IF ( STATUS ( J ) ) 200 , 250 , 260 
200  IF ( STATUS ( J ) . EQ . - 2  .OR.  STATUS ( J ). EQ . -3 ) 

1  GO  TO  230 

IF ( STATUS ( J ) . EQ . -4 ) GO  TO  250 

HERE  FOR  NON-BASIC  VARIABLES  AT  THEIR  UPPER 
BOUNDS . 

IF (BNDTYP.LT. 3) GO  TO  210 
VALUE=BESTUP ( J ) 

GO  TO  270 

IF (BNDTYP.LT. 2) GO  TO  220 
IF ( J . GT . NTYPE2 ) GO  TO  220 
VALUE =BOUND 
GO  TO  270 

WRITE( IOLOG, 905)  J 
FORMAT (16H  ERROR:  VARIABLE, 16, 

16H  IS  AT  ITS  UPPER, 

20H  BOUND  OF  +INFINITY.) 

GO  TO  280 

HERE  FOR  FREE  AND  ARTIFICIAL  VARIABLES. 

DO  240  1=1, M 

IF ( BASIS ( I )  .NE.  J ) GO  TO  240 
VALUE=XBZERO ( I ) 


210 


220 

905 

1 

2 


230 


ooo  o  o  o  ooo  ooo 
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GO  TO  270 
240  CONTINUE 

GO  TO  280 

HERE  FOR  NON-BASIC  VARIABLES  AT  THEIR  LOWER 
BOUNDS . 

250  IF ( BNDTYP  . NE .  4) GO  TO  280 

VALUE=BESTLO( J) 

GO  TO  270 

HERE  FOR  THE  BASIC  VARIABLES  (EXCEPT  FREE  AND 
ARTIFICIALS) 

260  IX=STATUS { J ) 

VALUE=XBZERO ( IX) 

IF( IX  .LE.  M) GO  TO  270 

HERE  FOR  SUPER-BASIC  VARIABLES. 

WRITE ( IOLOG , 908 ) J , STATUS ( J ) , VALUE 
908  FORMAT ( IX, 110 , 5X, 110 , IX, 2HSB , 2X,D15 . 8 ) 

GO  TO  280 

270  WRITE ( IOLOG , 906 )  J , STATUS ( J ) , VALUE 

906  FORMAT ( IX , I 10 , 5X , I 10 , 5X , D25 .12) 

280  CONTINUE 

PRINT  THE  OBJECTIVE  VALUE. 

WRITE ( IOLOG , 907)  Z 

907  FORMAT ( •  VALUE  OF  LINEAR  OBJECTIVE  1 , 

1  1  FUNCTION® 1  , D 1 5 . 8 ) 

C 

RETURN 

END 


>•* 


The  multilevel  programming  problem  as  viewed  by 


player  1  can  be  thought  of  as  a  standard  mathematical 


program  whose  feasible  region  has  been  augmented  to 


include  a  series  of  implicitly  defined  constraints.  The 


notation  proposed  by  Bialas  and  Karwan  (1982)  will  be 


used  to  clarify  this  interpretation  and  recursively 


build  up  a  succession  of  feasible  regions  for  each  of 


the  players  beginning  at  the  lowest  level.  This  will 


ultimately  lead  to  a  reformulation  of  problem  (2.1) 


To  begin,  let  (xa,x^)  be  an  arbitrary  partitioning 


of  xeR  and  denote  the  maximization  of  a  bounded 


function  f(xa,xb)  over  a  compact  region  ScRn  for  a  fixed 


value  of  x  by 


.  £ .  a  b.  a. 
max  ( f ( x  , x  )  :  x  ) 


(B.l) 


I 


l*. 


M- 


■5 


Z* 


In  the  case  of  bilevel  programming,  if  we  think  of  xa  as 
the  vector  under  the  control  of  player  1,  then  player  2 
is  faced  with  the  parameterized  problem  given  in  (B.l). 

Definition  B.l:  For  the  partition  (x  ,xD),  the  set  of 
rational  reactions  of  f  over  S  is  given  by:  W^(S)  = 

{ X€S  :  f(x)  =  max(f (xa,xb)  :  xa} . 

xb 

—ci  —to 

If  player  1  selects  x  and  there  exists  an  x  which 
uniquely  maximizes  f(xa,xb)  for  all  (xa,xb)eS,  then  the 
induced  mapping 

xb  =  if{xa) 

provides  the  rational  reaction  for  each  xa .  This 
suggests  an  alternative  representation  of  Wf(S)  which 
can  be  expressed  as 

Wf(S)  =  {xeS  :  xb  =  $  f ( xa ) } . 

In  effect,  W^(S)  denotes  the  feasible  set  for  player  1 
when  all  the  decision  variables  are  under  his  control. 
The  BLPP  can  thus  be  written  as 

max  [fa(x)  :  x€WfI(Sn(X1  *  X2))] 
which  in  part  supports  our  initial  interpretation.  When 


the  solution  to  (B.l)  is  not  unique,  becomes  a  point- 
to-point  mapping  and  the  above  formulation  must  be 
generalized  accordingly.  In  order  to  extend  the 
development  to  p  levels,  suppose  SpcRn  is  nonempty  and 
compact,  and  let  f 1  ( x)  ,  .  .  . , f P( x)  be  bounded  functions 
defined  over  S1.  Player  p,  at  the  lowest  level  in  the 
hierarchy,  must  then  solve 

max  [fP(x)  (x1,...,xp  1)] 

xPf-X1*  (P1) 

subject  to  x€SP 

which  is  a  standard  optimization  problem  parameterized 

X  n  -  j 

by  the  decision  vectors  xA,...,xp_  of  the  respective 
higher  level  players.  The  set  Sp  is  defined  as  the 
level-p  feasible  region  while  the  rational  reaction  set 

sp"2  5  Wfr  ( SP) 

is  termed  the  level- ( p-2 )  feasible  region . 

In  order  to  facilitate  the  presentation,  although 
most  of  our  results  will  hold  regardless,  it  will  now  be 
assumed  that  the  induced  mapping  § exists  and  that 
similarly  defined  mappings  $ f r  ,  i=p-l,...,2  also  exist. 
This  rules  out  that  case  of  multiple  optimal  solutions 
for  lower  level  problems  and  hence,  nonuniqueness  of 


objective  functions  at  higher  levels.  As  demonstrated 


I 


by  Bard  and  Falk  (1982a),  such  a  complication  might 
preclude  the  existence  of  a  solution  for  (2.1).  With 
this  assumption  we  can  write  the  solution  to  PP  as 
x?  =  §f,  (xp-1,  .  . .  ,x1) 

At  level  p-1  the  problem  is  given  by 

max  [fp_1(x)  :  (xp“2 . x1)] 

xp_1€Xp_1 

subject  to  X€SP_1 

where  xp  does  not  explicitly  appear  in  the  partition  of 
x  but  is  contained  implicitly  in  the  arguments  of  the 
objective  function.  That  is  we  can  rewrite  fp  (x)  as 
follows 


. xlj  s 


fp_1  ($  ff  (xp_1 ,  .  .  .x1 )  ,xp  1 


and  make  the  appropriate  substitutions  in  Pp 

Continuing  in  this  manner  the  level-k  feasible 
region  will  be  defined  inductively  as 

If  lr+ 1 

S  =wfKtl  (SK+1) 

with  the  associated  problem  at  that  level  given  by 


HBWWKff^ffW^jnononannTOrranonorjwJWTwrw'?:  wwi^w  vrmwrftnrjifvini 
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r  _k.  .  ,  k-1  1 . 1 

max  [f  (x)  :  (x  ,  .  .  .  ,  x  )] 

xk€Xk  (Pk) 

j£ 

subject  to  xeS 

This  establishes  the  Interdependence  of  each  player's 

k- 

problem.  For  the  following  partition  of  x  a  (x 

k  k+,  . 

x  ,x  )  where 


k-  _  .  p  k+1. 

x  a  (x*\  .  .  .  ,x  ) 


k+  _  ,  k-1 
x  a  (x 


.  .  ,x  ) , 

player  k's  problem  can  be  interpreted  as  one 

From  this 

point  of  view,  we  offer  a  pair  of  definitions  to  further 
clarify  the  meaning  of  feasibility  and  optimality  for 


lr+  jr  — 

parameterized  in  x  and  implicit  in  x 


the  MLPP . 


Definition  B.2:  A  point  (x*  ,  x*)  is  said  to  be  optimal 
with  respect  to  a  point  xi  +  if  (x1  .x*)  =  (xi  +  ), 
where  §^((x^+)  is  the  rational  reaction  for  problem  P*, 
i=p,...,2.  Such  a  point  x  will  be  called  feaslbe  to  the 


3 


ft 


MLPP. 
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* 

Definition  B.3:  A  point  x  is  said  to  be  an  optimal 

solution  to  the  MLPP  if 
* 

a)  x  is  feasible;  and, 

b)  for  all  feasible  points  xeS(X,  f1(x  )  >  f1(x),  where 
X  =  X1  x  X2  *  . . .  x  xP. 

Notice  that  part  b)  of  Definition  B.3  only  requires  that 
the  highest  level  player's  objective  function  be 
maximized;  part  a)  assures  that  each  of  the  lower  level 
players  achieves  the  best  results  possible  in  the  face 
of  higher  level  decisions.  In  fact  it  is  quite  likely 

“  i  * 

that  a  feasible  point  x  will  exist  such  that  f  (x)  > 
i  * 

f  (x  ) ,  i*p,  for  one  or  more  players.  Perhaps  more 
vexing  though  is  the  likelihood  that  an  infeasible  point 
x€S(X)  will  exist  such  that  fi(x)  >  f^fx  )  for  all  i, 
implying  that  the  optimal  solution  to  the  MLPP  may  not 
be  Pareto-optimal. 


1$ 


B.2  Example  B.l 


maxff1  =  2x2  -  x1)  where  x2  solves 


2  12  3  3 

max(f  =  lOx  +  6x  -  lx  )  where  x  solves 


max(f3  =  -x1  +  12x2  -  x3 ) 


1  2 

X  -  8X 

+ 

x3 

> 

-8 

1  2 
-3x  -  3x 

+ 

x3 

> 

-15 

2 

3 

X 

• 

2X 

> 

-12 

-2X2 

+ 

3x3 

> 

6 

3X1  -  x2 

> 

3 

5 

3 

,  x  >  0 ,  x 

>  0 

The  three  regions  for  this  example  are  depicted  in 


12  3 

Figure  B.l.  The  collective  choices  x  ,  x  ,  and  x  must 


fall  within  the  polyhedron  S  which  is  the  level -3 


3  1 

feasible  region .  From  f  it  can  be  seen  that  once  x 


and  x  are  chosen,  player  3  will  react  by  picking  the 


smallest  possible  value  of  x  .  This  produces  the 
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2 

rational  reaction  set  S  (the  level-2  feasible  region) 
denoted  by  the  hatched  faces  in  Figure  B.l.  Thus  ,  for 

x1  fixed  at  say  x1,  player  2's  parametric  problem  is  to 

2  -1  2  3 

maximize  f  =  lOx  +  6x  -  x  over 

S2  =  (X€S3  :  f3(x)  =  max(f3  =  -x1  +  12x2  +  x3  :  x2)} 

x3 

112 

Player  l's  problem  is  then  to  maximize  f  =  -x  +  2x 
over  the  second  reaction  set  S1  (the  level-1  feasible 
region)  which  is  marked  by  the  emboldened  edges. 
Specifically,  we  have 

S*  =  (xes3  :  f 2 (x)=max( f 2=  lOx1  +  6x2  -  x3  :  x1),  x1€S2} 

‘2 

x 

The  optimal  solution  to  the  overall  problem  is 

found  by  solving  the  highest  level  problem,  and  is 

denoted  by  point  H  in  Figure  B.l.  As  expected,  it 

1  3 

occurs  at  a  vertex  of  S  as  well  as  S  .  Point  F, 
represents  local  optimum  since  movement  in  any  feasible 

direction  away  from  this  point  will  produce  a  decrease 

1  3 

in  f  .  Finally,  an  examination  of  S  reveals  a  Pareto- 

optimum  at  (the  infeasible)  point  G;  that  is,  a  strict 

improvement  in  each  objective  function  is  realized  when 


we  move  from  H  to  G.  Table  B.l  summerizes  the  results 


for  these  three  situations. 


TABLE  B.l:  OBJECTIVE  FUNCTION  VALUES  OF  VARIOUS  OPTIMA 


Global 

Local 

Pareto 

Optimum,  H 

Optimum,  F 

Optimum,  G 

value  of  x 

(1.52,1.57,3.05) 

(4.91,2.27,4.47) 

(1.61,1.84,5.08) 

f1 

1 .  .2 

-0.07 

2.07 

f  2 

21.57 

53.41 

22.06 

f3 

14.27 

17.86 

15.39 

A  basic  assumption  in  multilevel  programming  rules 
out  cooperation  among  the  players.  As  demonstrated  in 
Example  B.l,  if  this  restriction  is  relaxed,  the  payoff 
realized  at  each  level  may  increase.  The  possibility  of 
nonefficient  solutions,  though  has  wider  implications 
for  our  work  because  it  discourages  the  adaptation  of 
algorithms  designed  to  solve  the  vector  maximization 
problem . 
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